-- Logs begin at Tue 2022-05-10 18:05:15 UTC, end at Tue 2022-05-10 19:20:44 UTC. -- May 10 18:43:16.790324 dv-cinder-836996-18-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 18:43:16.798814 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 18:43:16.801821 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 18:43:16 2022] *** May 10 18:43:16.802020 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 18:43:16.802178 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 18:43:16.802330 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: nodename: dv-cinder-836996-18-iscsi May 10 18:43:16.802479 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: machine: x86_64 May 10 18:43:16.802630 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: clock source: unix May 10 18:43:16.802777 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: pcre jit disabled May 10 18:43:16.802927 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: detected number of CPU cores: 4 May 10 18:43:16.803079 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: current working directory: / May 10 18:43:16.803225 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: detected binary path: /usr/bin/uwsgi-core May 10 18:43:16.803377 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: your processes number limit is 47680 May 10 18:43:16.803525 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: your memory page size is 4096 bytes May 10 18:43:16.803673 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: detected max file descriptor number: 2048 May 10 18:43:16.803847 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: lock engine: pthread robust mutexes May 10 18:43:16.804142 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: thunder lock: enabled May 10 18:43:16.804482 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 18:43:16.804726 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 18:43:16.848341 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: Python main interpreter initialized at 0x55697f7a29c0 May 10 18:43:16.848341 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: python threads support enabled May 10 18:43:16.848341 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: your server socket listen backlog is limited to 100 connections May 10 18:43:16.848341 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: your mercy for graceful operations on workers is 90 seconds May 10 18:43:16.848766 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: mapped 403077 bytes (393 KB) for 2 cores May 10 18:43:16.848766 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: *** Operational MODE: preforking *** May 10 18:43:16.849024 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: *** uWSGI is running in multiple interpreter mode *** May 10 18:43:16.849024 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: spawned uWSGI master process (pid: 79958) May 10 18:43:16.849198 dv-cinder-836996-18-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 18:43:16.852715 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: spawned uWSGI worker 1 (pid: 79970, cores: 1) May 10 18:43:16.852715 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: spawned uWSGI worker 2 (pid: 79971, cores: 1) May 10 18:43:16.852715 dv-cinder-836996-18-iscsi devstack@keystone.service[79958]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 18:43:22.529172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 18:43:22.529172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: from cryptography.utils import int_from_bytes May 10 18:43:22.530591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 18:43:22.530591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: from cryptography.utils import int_from_bytes May 10 18:43:22.532309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 18:43:22.532309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: from cryptography.utils import int_from_bytes May 10 18:43:22.533760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 18:43:22.533760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: from cryptography.utils import int_from_bytes May 10 18:43:22.578984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 18:43:22.579162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 18:43:22.579365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] command line args: [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 18:43:22.579601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 18:43:22.579727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ================================================================================ {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 18:43:22.579800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 18:43:22.579992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 18:43:22.580075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] admin_token = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.580135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] command line args: [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 18:43:22.580191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] config_dir = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.580366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.580453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 18:43:22.580589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] config_source = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.580667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ================================================================================ {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 18:43:22.580861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] debug = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.580932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] admin_token = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.580996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.581251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] config_dir = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.582291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.582571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] config_source = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.582776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.582979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] debug = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.583202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.583396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.583642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.583805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.584033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.584195 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.584382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] list_limit = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.584574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.584845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] log_config_append = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.584845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.585211 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.585403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] log_dir = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.585590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] list_limit = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.585825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] log_file = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.585990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] log_config_append = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.586213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.586381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.586381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] log_dir = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.586750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.586941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] log_file = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.587127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.587297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.587475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.587645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.587786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.587786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.588072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.588215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.588355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.588355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.588605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.588770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.588904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.589962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.590116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.590246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.590385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.590521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.590655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.590655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.590918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] publish_errors = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] publish_errors = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.591941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.592068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.592194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.592433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.592433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.592863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] standard_threads = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.592863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.593115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.593253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.593387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.593520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.593646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] standard_threads = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.593780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] use_journal = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.593906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] use_json = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] use_stderr = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] use_syslog = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] use_journal = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.594970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] use_json = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.595210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.595336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] use_stderr = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.595461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.595593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] use_syslog = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.595731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.595869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 18:43:22.596005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.596139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.596266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.596401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.596537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.596664 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.596825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.596952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.597087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.597221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.597431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.597566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.597693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.597819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.597945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.598078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.598212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.598357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.598484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.598617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.598751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.598889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.599921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.600064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.600191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.600325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.600461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.600593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.600749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.600890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.601923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.602971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.603096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.603221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.603353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.603484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.603699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.603828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.603954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.604080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.604205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.604330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.604465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.604594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.604745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.604875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605022 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.605925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.606061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.606189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.606316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.606441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.606567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.606743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.606875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.607001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.607127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.607510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.607648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.607789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.607917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.608044 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.608408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.608604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.608836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.609033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.609196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.609383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.609570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.609764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.609959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.610166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.610362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.610620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.610819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.610983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.611170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.611551 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.611715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.611911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.612106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.612301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.612497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.612757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.612933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.613131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.613289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.613449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.613607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.613746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.613887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.614058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.614197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.614331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.614459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.614593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.614748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.614899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.615029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.615421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.615567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.615696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.615835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.615975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.616142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.616273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.616400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.616527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.616654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.616813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.616942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.617937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.618070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.618198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.618333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.618461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.618595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.618765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.618925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.619053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.619260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.619391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.619519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.619646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.619773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.619901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.620037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.620171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.620306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.620433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.620560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.620738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.620881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.621987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.622148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.622278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.622415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.622553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.622702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.622831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.622964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.623987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.624114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.624255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.624395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.624524 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.624650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.624800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.624928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.625070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] auth.external = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.625198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.625396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.625528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.625663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.625792 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.625936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.626066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.626193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] auth.password = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.626330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.626458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] auth.token = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.626586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.626721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.626876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] auth.external = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.627935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.628075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.628209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.628336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.628464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] auth.password = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.628602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] credential.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.628782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] auth.token = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.628913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.629958 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] credential.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.630998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.631125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.631253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.631380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.631508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.631654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.631784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.631911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.632967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.633095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.633233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.633363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.633501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.633630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.633630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.633871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.634996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.635124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.635253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.635391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.635519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.635659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.635788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.636286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.636421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.636592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.636796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.636939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.637998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.638127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.638255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.638382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.638518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.638655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.638783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.638918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.639045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.639174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.639359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.639500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.639635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.639763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.639891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640414 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.640961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.641089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.641229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.641359 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.641487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.641624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.641752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.641880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.642785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643444 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.643964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.644092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.644220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.644348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.644476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.644604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.644771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.644904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.645947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.646075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.646209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.646354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.646485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.646627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.646755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.646883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.647945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.648073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.648201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.648330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.648468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.648597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.648775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.648908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.649945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650211 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.650851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.651103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.651103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.651345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.651473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.651601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.651733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.651870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.652008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.652138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.652266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.652394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.652523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.652660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.652811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.653952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.654080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.654217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.654347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.654475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.654603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.654737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.654866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.655924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.656053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.656187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.656318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.656446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.656659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.656839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.656970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.657098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.657227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.657355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.657494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.657635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.657763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.657891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.658933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.659984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.660113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.660241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.660369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.660497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.660723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.660859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.660988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.661117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.661257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.661386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.661523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.661652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.661780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.661908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] role.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] role.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.662944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.663090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.663221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.663350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.663480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.663608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.663736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.663873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.664002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.664131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.664269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.664397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.664525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.664662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.664866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] role.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] role.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.665933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.666986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.667116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.667244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.667372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.667509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.667637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.667774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.667903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.668970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.669996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.670142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.670272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.670400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.670528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.670658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.670785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.670922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.671975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.672133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.672264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.672391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.672528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.672659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.672822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.672950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.673078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.673206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.673345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.673476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.673604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.673744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.673876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.674916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.675946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.676074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.676214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.connection = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.676365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.676504 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.676640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.676796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.676796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.677071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.677206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.677336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.677486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.677617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.677744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.677873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.678910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.connection = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.679985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.680990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.681246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.682379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.682379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.682379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.682379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.682379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 18:43:22.682379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 18:43:22.693690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.693919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.694145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.695959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.696200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.696430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.702906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.705285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.731047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.731263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.733018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.733300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.784116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.785296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.835020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.835330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.836638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.836919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.900056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.900363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.900517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.900711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.900860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.900999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.901138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.901286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.901436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.901575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.901714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.901714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.923983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.924214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.924443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.924657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.924898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.925111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.925325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.925683 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.926015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.926339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.926678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.926997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.927323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.927643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.936601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.938403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.951044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.951350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.951494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.951701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.951915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.952093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.952177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.952333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79970) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.952567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.952954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.953233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.953630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.953942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.954253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79971) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 18:43:22.969612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.969826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 18:43:22.970155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.970299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.970386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 18:43:22.970606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.970731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 18:43:22.970814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.971074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.971343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.971525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.971690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 18:43:22.972054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.972377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.972712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.973035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.982298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.982570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.982835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.983112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.984457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.984893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.985229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.985578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.991312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:22.994023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:22.994596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:22.994868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.995144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.995525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.995800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.996063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.996333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.996599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.996886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.997141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.997400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.998137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:22.998484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.998832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.999292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.999641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:22.999970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.000331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.000700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.000967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.001243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.001510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.028542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.028939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.030407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.030535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.030822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.030947 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.036141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.036415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.036542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.036646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.037001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.037382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.043982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.044264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.045036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.045416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.049071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.049350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.049628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.049910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.050184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.050455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.050717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.050842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.050961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.051302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.051674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.052050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.052418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.052816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.053184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.053565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.069648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.069911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.072601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.072997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.074431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.077739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.078077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.078394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.081831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.082215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.083475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.087084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.087529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.090837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.091135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.091416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.091542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.091705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.091976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.092223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.095687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.096096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.096491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.096906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.097292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.097677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.114065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.114444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.114711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.114972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.117353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.118153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.118534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.118910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.123253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.124995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.125319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.127385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.128391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.128688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.128978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.129258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.129530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.129706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.130101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.133349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.133735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.134124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.134531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.134933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.143380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.143645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.143925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.144200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.144489 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.144793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.145063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.149648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.150038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.150442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.150842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.151230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.151607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.151993 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.163201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.166525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.169864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.170689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.171471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.173165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.173440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.173713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.174556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.178050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.179776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.181178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.181661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.182044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.182437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.182784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.186029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.186314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.186601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.186875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.191329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.193083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.196252 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.196543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.196690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.196794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.197103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.197494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.197887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.204908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79971) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.205126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.205407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.205679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.205948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.206232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.206511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.206774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.207046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.207293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.207572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.207842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.208116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.208370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79971) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.208600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.209019 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.209399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.217449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79970) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 18:43:23.217843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.218230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.218645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.219077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.219478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.219866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.220252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.220626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.221025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.221403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.221790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.222176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.222541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79970) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 18:43:23.247916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55697f7a29c0 pid: 79971 (default app) May 10 18:43:23.251363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974257-56c2-455c-a9e0-f47d4b333535 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:23.251661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974257-56c2-455c-a9e0-f47d4b333535 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:23.251949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7974257-56c2-455c-a9e0-f47d4b333535 None None] PATH_INFO: `/v3` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:23.256737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Tue May 10 18:43:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:23.262529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55697f7a29c0 pid: 79970 (default app) May 10 18:43:31.205182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea916c4-63de-40c8-afa3-c8fdc13e0471 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:31.205785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea916c4-63de-40c8-afa3-c8fdc13e0471 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:31.205785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea916c4-63de-40c8-afa3-c8fdc13e0471 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:31.207110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:43:31.215029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:31.215472 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:31.215597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:31.247140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG oslo_db.sqlalchemy.engines [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 18:43:31.429421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG passlib.handlers.bcrypt [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79970) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 18:43:31.429829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG passlib.handlers.bcrypt [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79970) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 18:43:31.485130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:31.486674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:31.614648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1/3] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 18:43:31.800104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea916c4-63de-40c8-afa3-c8fdc13e0471 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:31.835299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG oslo_db.sqlalchemy.engines [None req-dea916c4-63de-40c8-afa3-c8fdc13e0471 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 18:43:31.960592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea916c4-63de-40c8-afa3-c8fdc13e0471 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:31.965505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c9a6-479a-49c4-869f-bc3acd8968ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:31.966171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9a6-479a-49c4-869f-bc3acd8968ea admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:31.966457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9a6-479a-49c4-869f-bc3acd8968ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:31.966734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9a6-479a-49c4-869f-bc3acd8968ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:31.975160 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c9a6-479a-49c4-869f-bc3acd8968ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:32.026617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING keystone.common.rbac_enforcer.enforcer [None req-83c3c9a6-479a-49c4-869f-bc3acd8968ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 18:43:32.026958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c9a6-479a-49c4-869f-bc3acd8968ea admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:32.037305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1324 bytes} [Tue May 10 18:43:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 18:43:32.043654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:32.058566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16b38d-aae7-460e-9bba-b7ebd3e47850 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:32.064353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc2530-abfc-474d-bfe8-a10171d1b8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:32.065533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc2530-abfc-474d-bfe8-a10171d1b8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:32.065818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc2530-abfc-474d-bfe8-a10171d1b8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:32.066106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc2530-abfc-474d-bfe8-a10171d1b8c9 admin admin] PATH_INFO: `/v3/projects/55014cd93ec34248b9cee6790f6f8c90` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:32.067781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc2530-abfc-474d-bfe8-a10171d1b8c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=55014cd93ec34248b9cee6790f6f8c90)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:32.117269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4dcc2530-abfc-474d-bfe8-a10171d1b8c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 18:43:32.117613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc2530-abfc-474d-bfe8-a10171d1b8c9 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:32.122370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 2/5] 10.222.0.52 () {56 vars in 1207 bytes} [Tue May 10 18:43:32 2022] GET /identity/v3/projects/55014cd93ec34248b9cee6790f6f8c90 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:34.323004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edfdc-04d2-4440-bd22-f72eee0bc244 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:34.323576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edfdc-04d2-4440-bd22-f72eee0bc244 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:34.323576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edfdc-04d2-4440-bd22-f72eee0bc244 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:34.327700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 4/6] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:43:34.333383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef884a85-b1e2-4b33-85de-4e363c7b2d51 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:34.333807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef884a85-b1e2-4b33-85de-4e363c7b2d51 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:34.333896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef884a85-b1e2-4b33-85de-4e363c7b2d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:34.354361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ef884a85-b1e2-4b33-85de-4e363c7b2d51 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:34.355902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ef884a85-b1e2-4b33-85de-4e363c7b2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:34.364599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 18:43:34.386927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8edfdc-04d2-4440-bd22-f72eee0bc244 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:34.400835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8edfdc-04d2-4440-bd22-f72eee0bc244 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:34.405781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e901e-6a59-4f2a-85a4-f0e93373565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:34.406522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e901e-6a59-4f2a-85a4-f0e93373565b admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:34.406808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e901e-6a59-4f2a-85a4-f0e93373565b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:34.407073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e901e-6a59-4f2a-85a4-f0e93373565b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:34.414784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e901e-6a59-4f2a-85a4-f0e93373565b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:34.416598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e901e-6a59-4f2a-85a4-f0e93373565b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:34.425161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1324 bytes} [Tue May 10 18:43:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 18:43:34.430942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef884a85-b1e2-4b33-85de-4e363c7b2d51 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:34.440603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef884a85-b1e2-4b33-85de-4e363c7b2d51 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:34.446016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997e719-a57b-4e4d-aa33-72eda62060b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:34.446986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997e719-a57b-4e4d-aa33-72eda62060b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:34.447263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997e719-a57b-4e4d-aa33-72eda62060b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:34.447540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997e719-a57b-4e4d-aa33-72eda62060b3 admin admin] PATH_INFO: `/v3/users/7ac1c607394142e496b17c3444cb39d5` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:34.449130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997e719-a57b-4e4d-aa33-72eda62060b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7ac1c607394142e496b17c3444cb39d5)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:34.450982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997e719-a57b-4e4d-aa33-72eda62060b3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:34.452936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 4/9] 10.222.0.52 () {56 vars in 1198 bytes} [Tue May 10 18:43:34 2022] GET /identity/v3/users/7ac1c607394142e496b17c3444cb39d5 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:36.748620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f2c90-4a0f-4ce0-a71c-9268ed68d134 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:36.749166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f2c90-4a0f-4ce0-a71c-9268ed68d134 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:36.749166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f2c90-4a0f-4ce0-a71c-9268ed68d134 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:36.750654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:36.756139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637d0e4-4c4a-42f6-ad51-6f50be04d7f7 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:36.756558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637d0e4-4c4a-42f6-ad51-6f50be04d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:36.756668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637d0e4-4c4a-42f6-ad51-6f50be04d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:36.777962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9abcf0-1921-4462-a3d6-ec4d399e8dbe None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:36.778256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9abcf0-1921-4462-a3d6-ec4d399e8dbe None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:36.778536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9abcf0-1921-4462-a3d6-ec4d399e8dbe None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:36.779946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 7/11] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:36.786173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:36.786462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:36.786743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:36.830312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG passlib.handlers.bcrypt [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79971) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 18:43:36.830754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG passlib.handlers.bcrypt [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79971) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 18:43:36.878392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:36.880024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:36.886862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-6637d0e4-4c4a-42f6-ad51-6f50be04d7f7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:36.888025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6637d0e4-4c4a-42f6-ad51-6f50be04d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:36.968097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 5/12] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:43:36.980491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 8/13] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:36.991453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637d0e4-4c4a-42f6-ad51-6f50be04d7f7 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.002132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.088763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637d0e4-4c4a-42f6-ad51-6f50be04d7f7 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.097704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b65d2d-609e-4a1f-87c2-d1a96ee4aa0b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.119959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.120790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.121072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.121349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.130233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.131143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.131433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.131714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.132327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:37.143885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:37.145101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:37.145936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 6/14] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:37.150967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.197427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:37.198975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:37.247084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170527-9fbc-4090-8cbd-e57aca921638 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.281523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.282121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.282405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.282685 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.283454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:37.283768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:37.285213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:37.294883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 9/15] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:43:37.297042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 7/16] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:43:37.300708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.302473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.395815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b27a92-dbb8-4078-847b-9e665a20f5f4 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.396033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af893d6-5c8e-4f49-835c-a9ba608639b6 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.430964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.431524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.431886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.432170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.432294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.432449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] PATH_INFO: `/v3/users/7ac1c607394142e496b17c3444cb39d5` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.432590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.432895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.433776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] RBAC: Authorizing `identity:get_user(user_id=7ac1c607394142e496b17c3444cb39d5)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:37.435259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:37.436917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 8/17] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:37 2022] GET /identity/v3/users/7ac1c607394142e496b17c3444cb39d5 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:37.442481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.548547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0edb49-19fb-462c-a81e-43d614f481ad None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.563614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:37.565122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:37.581880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.582691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.582978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.583256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.584485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:37.585955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:43:37.586871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:37.587967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:37.589069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:43:37.589069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:43:37.589069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:43:37.589069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:43:37.589330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:43:37.593284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:37.594694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.599230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:37.697688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c269e3-87fc-42df-8beb-d08d0146f7e4 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.702906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dd023-cb67-4e9e-b79e-0317c0884c48 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:37.732786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b31a9-1186-42e9-bf51-8fb3f1d2d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.733465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b31a9-1186-42e9-bf51-8fb3f1d2d29d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.733749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b31a9-1186-42e9-bf51-8fb3f1d2d29d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.734030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b31a9-1186-42e9-bf51-8fb3f1d2d29d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.734970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b31a9-1186-42e9-bf51-8fb3f1d2d29d None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.domain.id=default, user.id=7ac1c607394142e496b17c3444cb39d5) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:37.735287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b31a9-1186-42e9-bf51-8fb3f1d2d29d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:37.736761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b31a9-1186-42e9-bf51-8fb3f1d2d29d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:37.739364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824e1ff-99ad-4a0e-960d-b32d8bdf6e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:37.740053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824e1ff-99ad-4a0e-960d-b32d8bdf6e93 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:37.740338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824e1ff-99ad-4a0e-960d-b32d8bdf6e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:37.740617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824e1ff-99ad-4a0e-960d-b32d8bdf6e93 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:37.741382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824e1ff-99ad-4a0e-960d-b32d8bdf6e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:37.741693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824e1ff-99ad-4a0e-960d-b32d8bdf6e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:37.743081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824e1ff-99ad-4a0e-960d-b32d8bdf6e93 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:37.743607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1322 bytes} [Tue May 10 18:43:37 2022] GET /identity/v3/role_assignments?user.id=7ac1c607394142e496b17c3444cb39d5&scope.domain.id=default&role.id=4222709f8e2845f1943f943370bcd122 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:37.762713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:40.141192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6faf5f-ab8a-4c47-82a6-c76d969ea688 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.142170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6faf5f-ab8a-4c47-82a6-c76d969ea688 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.142660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6faf5f-ab8a-4c47-82a6-c76d969ea688 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.144560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:40.158555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335f86-9516-44ec-83dc-070bb93e5153 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.159352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335f86-9516-44ec-83dc-070bb93e5153 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.159829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335f86-9516-44ec-83dc-070bb93e5153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.181997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e2335f86-9516-44ec-83dc-070bb93e5153 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:40.183517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e2335f86-9516-44ec-83dc-070bb93e5153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:40.271420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:43:40.306383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6faf5f-ab8a-4c47-82a6-c76d969ea688 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:40.457397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6faf5f-ab8a-4c47-82a6-c76d969ea688 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:40.495755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4aace-aa3e-41a8-8d62-57b2592fec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:40.497009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4aace-aa3e-41a8-8d62-57b2592fec6b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.497482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4aace-aa3e-41a8-8d62-57b2592fec6b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.497940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4aace-aa3e-41a8-8d62-57b2592fec6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.521885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4aace-aa3e-41a8-8d62-57b2592fec6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c4c4aace-aa3e-41a8-8d62-57b2592fec6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:40.529923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:40.530759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:40.531650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:40.538803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 12/24] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:40.540529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335f86-9516-44ec-83dc-070bb93e5153 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:40.609872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c867361-60a9-419e-9ad1-422e73e717dd None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.610521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c867361-60a9-419e-9ad1-422e73e717dd None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.611027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c867361-60a9-419e-9ad1-422e73e717dd None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.612953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 13/25] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:43:40.626476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d171aac-fc33-4d89-9cd4-35adc4cc8583 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.627073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d171aac-fc33-4d89-9cd4-35adc4cc8583 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.627554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d171aac-fc33-4d89-9cd4-35adc4cc8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.658043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7d171aac-fc33-4d89-9cd4-35adc4cc8583 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:40.659604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7d171aac-fc33-4d89-9cd4-35adc4cc8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:40.681572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335f86-9516-44ec-83dc-070bb93e5153 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:40.719055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:40.719666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.719953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.720233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.721048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:40.721359 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:40.722765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:40.747031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 13/26] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:40.754635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:40.802000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 14/27] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:43:40.845344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d171aac-fc33-4d89-9cd4-35adc4cc8583 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:40.920577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00e679-8947-4743-b85b-a94435906779 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:40.966345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7bf5e-f3af-4e0d-a055-fc7d394f0f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:40.967257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7bf5e-f3af-4e0d-a055-fc7d394f0f3a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.967542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7bf5e-f3af-4e0d-a055-fc7d394f0f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.967823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7bf5e-f3af-4e0d-a055-fc7d394f0f3a None admin] PATH_INFO: `/v3/users/7ac1c607394142e496b17c3444cb39d5` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.970692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7bf5e-f3af-4e0d-a055-fc7d394f0f3a None admin] RBAC: Authorizing `identity:get_user(user_id=7ac1c607394142e496b17c3444cb39d5)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:40.972117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7bf5e-f3af-4e0d-a055-fc7d394f0f3a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:40.973808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 14/28] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:40 2022] GET /identity/v3/users/7ac1c607394142e496b17c3444cb39d5 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:40.975009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8cd73-d31e-4e63-ad62-87d83a2c56a8 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:40.975733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8cd73-d31e-4e63-ad62-87d83a2c56a8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:40.976123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8cd73-d31e-4e63-ad62-87d83a2c56a8 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:40.977373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 15/29] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:40.981751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8cd73-d31e-4e63-ad62-87d83a2c56a8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:41.037862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d171aac-fc33-4d89-9cd4-35adc4cc8583 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:41.078505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673e95d-b932-4fad-bd24-5936d3a6b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:41.079582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673e95d-b932-4fad-bd24-5936d3a6b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.080066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673e95d-b932-4fad-bd24-5936d3a6b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.080559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673e95d-b932-4fad-bd24-5936d3a6b9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.091033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673e95d-b932-4fad-bd24-5936d3a6b9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:41.092844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673e95d-b932-4fad-bd24-5936d3a6b9c0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f673e95d-b932-4fad-bd24-5936d3a6b9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:43:41.113747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:41.114595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:41.115408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:43:41.115408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:43:41.115408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:43:41.115408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:41.117447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 15/30] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:43:41.119004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b177a7-20b5-40cf-9730-98238c6b4a88 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.119502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b177a7-20b5-40cf-9730-98238c6b4a88 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.119967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b177a7-20b5-40cf-9730-98238c6b4a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.127819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8cd73-d31e-4e63-ad62-87d83a2c56a8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:41.138058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-95b177a7-20b5-40cf-9730-98238c6b4a88 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:41.139583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-95b177a7-20b5-40cf-9730-98238c6b4a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:41.162206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433cca2-86fc-4ab0-b8ae-f5f6ae4294ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:41.163608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433cca2-86fc-4ab0-b8ae-f5f6ae4294ac None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.164115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433cca2-86fc-4ab0-b8ae-f5f6ae4294ac None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.164582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433cca2-86fc-4ab0-b8ae-f5f6ae4294ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.166015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433cca2-86fc-4ab0-b8ae-f5f6ae4294ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:41.167668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433cca2-86fc-4ab0-b8ae-f5f6ae4294ac None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:41.169897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 16/31] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:41.171418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc55a7-5510-4d82-96c5-a8f23767200e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.171965 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc55a7-5510-4d82-96c5-a8f23767200e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.172538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc55a7-5510-4d82-96c5-a8f23767200e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.174783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 17/32] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:41.175679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc55a7-5510-4d82-96c5-a8f23767200e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:41.212545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 16/33] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:41.220931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b177a7-20b5-40cf-9730-98238c6b4a88 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:41.300398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc55a7-5510-4d82-96c5-a8f23767200e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:41.334832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1b1b7-3e57-4f80-b329-8ac3eafc9544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:41.335746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b1b7-3e57-4f80-b329-8ac3eafc9544 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.336174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b1b7-3e57-4f80-b329-8ac3eafc9544 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.336304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b177a7-20b5-40cf-9730-98238c6b4a88 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:41.336753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b1b7-3e57-4f80-b329-8ac3eafc9544 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.337708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b1b7-3e57-4f80-b329-8ac3eafc9544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:41.338239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b1b7-3e57-4f80-b329-8ac3eafc9544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:41.339821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b1b7-3e57-4f80-b329-8ac3eafc9544 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:41.352192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 18/34] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:41.353721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987630-f927-43c4-b989-315f6cbaf3da None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.354226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987630-f927-43c4-b989-315f6cbaf3da None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.354769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987630-f927-43c4-b989-315f6cbaf3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.371321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:41.371532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3b987630-f927-43c4-b989-315f6cbaf3da None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:41.372560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.372917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3b987630-f927-43c4-b989-315f6cbaf3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:41.373191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.373606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] PATH_INFO: `/v3/domains/default/users/7ac1c607394142e496b17c3444cb39d5/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.376072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7ac1c607394142e496b17c3444cb39d5, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:41.377849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:41.451752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 19/35] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:41.453042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987630-f927-43c4-b989-315f6cbaf3da None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:41.524332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 17/36] 10.222.0.52 () {58 vars in 1361 bytes} [Tue May 10 18:43:41 2022] PUT /identity/v3/domains/default/users/7ac1c607394142e496b17c3444cb39d5/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:43:41.525587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:41.577135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987630-f927-43c4-b989-315f6cbaf3da None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:41.614244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e00d3-ebf0-4796-869b-4ffe5cb9f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:41.615362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e00d3-ebf0-4796-869b-4ffe5cb9f7b5 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.615838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e00d3-ebf0-4796-869b-4ffe5cb9f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.616321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e00d3-ebf0-4796-869b-4ffe5cb9f7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.617346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e00d3-ebf0-4796-869b-4ffe5cb9f7b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:41.618950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e00d3-ebf0-4796-869b-4ffe5cb9f7b5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:41.639989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ddac-c7ac-4863-8ab8-204b458a9a29 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:41.715064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:41.715772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.716066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.716343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.717156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:41.718913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:41.782363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:43:41 2022] POST /identity/v3/projects => generated 301 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:41.782915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:41.806716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 20/38] 10.222.0.52 () {60 vars in 1131 bytes} [Tue May 10 18:43:41 2022] POST /identity/v3/roles => generated 219 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:41.808142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cec922-19c3-470a-bf39-25e441e27e8d None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.808440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cec922-19c3-470a-bf39-25e441e27e8d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.808761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cec922-19c3-470a-bf39-25e441e27e8d None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.810034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 21/39] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:41.817388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5b1d-ab21-4278-8eb3-b8c47256ee1b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:41.818032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5b1d-ab21-4278-8eb3-b8c47256ee1b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:41.818514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5b1d-ab21-4278-8eb3-b8c47256ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:41.839617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4bfc5b1d-ab21-4278-8eb3-b8c47256ee1b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:41.841824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4bfc5b1d-ab21-4278-8eb3-b8c47256ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:41.921855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 22/40] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:43:41.945614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc5b1d-ab21-4278-8eb3-b8c47256ee1b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:41.960878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a7831-fa80-4687-ae6f-80d570e43d8c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:42.046252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46675-a392-4d38-9975-5e27d37b4f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:42.047103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46675-a392-4d38-9975-5e27d37b4f9f None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:42.047507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46675-a392-4d38-9975-5e27d37b4f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:42.047674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46675-a392-4d38-9975-5e27d37b4f9f None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:42.048495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46675-a392-4d38-9975-5e27d37b4f9f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:42.054285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46675-a392-4d38-9975-5e27d37b4f9f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:42.059332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc5b1d-ab21-4278-8eb3-b8c47256ee1b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:42.103315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53e7d7-3814-48c2-a89d-8a6aae9a0331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:42.104425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e7d7-3814-48c2-a89d-8a6aae9a0331 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:42.104965 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e7d7-3814-48c2-a89d-8a6aae9a0331 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:42.105442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e7d7-3814-48c2-a89d-8a6aae9a0331 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:42.106411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 19/41] 10.222.0.52 () {60 vars in 1131 bytes} [Tue May 10 18:43:41 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:42.106752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e7d7-3814-48c2-a89d-8a6aae9a0331 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:42.108643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e7d7-3814-48c2-a89d-8a6aae9a0331 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:42.127932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 23/42] 10.222.0.52 () {60 vars in 1131 bytes} [Tue May 10 18:43:41 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:43:42.292607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513c3c-6f72-42bc-abe6-99ee129dfb74 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:42.293180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513c3c-6f72-42bc-abe6-99ee129dfb74 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:42.293180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b513c3c-6f72-42bc-abe6-99ee129dfb74 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:42.294705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 20/43] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:42.301421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f1dd-4038-4234-8f69-c7f24e7c04bf None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:42.301913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f1dd-4038-4234-8f69-c7f24e7c04bf None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:42.301913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f1dd-4038-4234-8f69-c7f24e7c04bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:42.324017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e138f1dd-4038-4234-8f69-c7f24e7c04bf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:42.325364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e138f1dd-4038-4234-8f69-c7f24e7c04bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:42.409277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 24/44] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:42.432271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b513c3c-6f72-42bc-abe6-99ee129dfb74 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:42.529905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b513c3c-6f72-42bc-abe6-99ee129dfb74 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:42.562657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5d6ca-f107-4db5-81ea-a3bcac9ad2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:42.563390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d6ca-f107-4db5-81ea-a3bcac9ad2d0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:42.563675 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d6ca-f107-4db5-81ea-a3bcac9ad2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:42.563959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d6ca-f107-4db5-81ea-a3bcac9ad2d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:42.565237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5d6ca-f107-4db5-81ea-a3bcac9ad2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:42.566708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5d6ca-f107-4db5-81ea-a3bcac9ad2d0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:42.568347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 21/45] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:42.574071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f1dd-4038-4234-8f69-c7f24e7c04bf None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:42.673744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f1dd-4038-4234-8f69-c7f24e7c04bf None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:42.707438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edbfd1-0815-4d86-8d10-b48da8d04ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:42.708107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edbfd1-0815-4d86-8d10-b48da8d04ed9 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:42.708389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edbfd1-0815-4d86-8d10-b48da8d04ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:42.708667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edbfd1-0815-4d86-8d10-b48da8d04ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:42.709391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edbfd1-0815-4d86-8d10-b48da8d04ed9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:42.710852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edbfd1-0815-4d86-8d10-b48da8d04ed9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:42.737889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 25/46] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:43:42 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:44.007949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daffa6f-e273-4487-b111-c2f7ab08d347 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.008497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daffa6f-e273-4487-b111-c2f7ab08d347 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.008497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daffa6f-e273-4487-b111-c2f7ab08d347 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.009934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 22/47] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:44.015707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1cecf-a8eb-4f1f-857d-c7a45c098b6c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.016121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1cecf-a8eb-4f1f-857d-c7a45c098b6c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.016303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1cecf-a8eb-4f1f-857d-c7a45c098b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.034575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5ef1cecf-a8eb-4f1f-857d-c7a45c098b6c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:44.035756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5ef1cecf-a8eb-4f1f-857d-c7a45c098b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:44.100880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:44.123877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daffa6f-e273-4487-b111-c2f7ab08d347 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:44.225949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daffa6f-e273-4487-b111-c2f7ab08d347 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:44.258962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:44.259707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.259991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.260265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.271080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:44.278654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:44.279598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:44.280356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 23/49] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:44.285919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1cecf-a8eb-4f1f-857d-c7a45c098b6c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:44.384089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1cecf-a8eb-4f1f-857d-c7a45c098b6c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:44.419245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:44.419921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.420200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.420476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.421277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:44.421582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:44.422990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:44.431486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 27/50] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:44.437210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:44.539224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3133026-a5dc-42bb-8abe-83e467b9ea6e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:44.573475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:44.574446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.574731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.575002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] PATH_INFO: `/v3/users/7ac1c607394142e496b17c3444cb39d5` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.576342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] RBAC: Authorizing `identity:get_user(user_id=7ac1c607394142e496b17c3444cb39d5)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:44.577861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:44.579577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 24/51] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:44 2022] GET /identity/v3/users/7ac1c607394142e496b17c3444cb39d5 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:44.585246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:44.684924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee5622-5d5c-481f-9c0d-6adb928083d3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:44.717859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c2e72-7180-4d86-b569-c69147f9dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:44.718687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2e72-7180-4d86-b569-c69147f9dc3c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.719001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2e72-7180-4d86-b569-c69147f9dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.719276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2e72-7180-4d86-b569-c69147f9dc3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.720500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c2e72-7180-4d86-b569-c69147f9dc3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:44.721981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c2e72-7180-4d86-b569-c69147f9dc3c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:44.723787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 28/52] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:44.729635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:44.835552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92a8e-9f40-4abc-a103-7421b1db01b5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:44.869132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2aa6c-e338-45cc-bdff-c3e242ca1b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:44.869767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2aa6c-e338-45cc-bdff-c3e242ca1b71 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.870082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2aa6c-e338-45cc-bdff-c3e242ca1b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.870327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2aa6c-e338-45cc-bdff-c3e242ca1b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.871173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2aa6c-e338-45cc-bdff-c3e242ca1b71 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.domain.id=default, user.id=7ac1c607394142e496b17c3444cb39d5) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:44.871519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2aa6c-e338-45cc-bdff-c3e242ca1b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:44.873001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2aa6c-e338-45cc-bdff-c3e242ca1b71 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:44.879275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 25/53] 10.222.0.52 () {56 vars in 1322 bytes} [Tue May 10 18:43:44 2022] GET /identity/v3/role_assignments?user.id=7ac1c607394142e496b17c3444cb39d5&scope.domain.id=default&role.id=4222709f8e2845f1943f943370bcd122 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:44.974547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfb1d-33c7-449e-82c8-a7007dbe3ab2 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.974843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfb1d-33c7-449e-82c8-a7007dbe3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.975125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfb1d-33c7-449e-82c8-a7007dbe3ab2 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:44.976526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 29/54] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:44.982698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309e4f3-fab7-4620-8bcc-9d5e508e7e1b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:44.983074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309e4f3-fab7-4620-8bcc-9d5e508e7e1b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:44.983360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309e4f3-fab7-4620-8bcc-9d5e508e7e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:45.002488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-3309e4f3-fab7-4620-8bcc-9d5e508e7e1b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:45.004059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3309e4f3-fab7-4620-8bcc-9d5e508e7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:45.076625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 26/55] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:45.099525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bfb1d-33c7-449e-82c8-a7007dbe3ab2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:45.202989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bfb1d-33c7-449e-82c8-a7007dbe3ab2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:45.240186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa257-2677-47e9-946e-6c7f7712cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:45.241021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa257-2677-47e9-946e-6c7f7712cf85 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:45.241303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa257-2677-47e9-946e-6c7f7712cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:45.241582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa257-2677-47e9-946e-6c7f7712cf85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:45.242847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa257-2677-47e9-946e-6c7f7712cf85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:45.244315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa257-2677-47e9-946e-6c7f7712cf85 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:45.245986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 30/56] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:45.252096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309e4f3-fab7-4620-8bcc-9d5e508e7e1b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:45.351398 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309e4f3-fab7-4620-8bcc-9d5e508e7e1b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:45.384857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d7ada-17c8-4823-9547-f2a76e4a0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:45.385517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7ada-17c8-4823-9547-f2a76e4a0364 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:45.385803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7ada-17c8-4823-9547-f2a76e4a0364 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:45.386442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7ada-17c8-4823-9547-f2a76e4a0364 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:45.387158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d7ada-17c8-4823-9547-f2a76e4a0364 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:45.388618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d7ada-17c8-4823-9547-f2a76e4a0364 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:45.419459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 27/57] 10.222.0.52 () {60 vars in 1140 bytes} [Tue May 10 18:43:45 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:47.605319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915d1f8-5bfa-40a3-a0a1-e35ae110909f None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:47.606138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915d1f8-5bfa-40a3-a0a1-e35ae110909f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:47.606138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915d1f8-5bfa-40a3-a0a1-e35ae110909f None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:47.608392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 31/58] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:47.614373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2e0a-f862-4eed-b9de-f08bcf2dda12 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:47.614798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2e0a-f862-4eed-b9de-f08bcf2dda12 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:47.614885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2e0a-f862-4eed-b9de-f08bcf2dda12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:47.633400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-eb5a2e0a-f862-4eed-b9de-f08bcf2dda12 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:47.634568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-eb5a2e0a-f862-4eed-b9de-f08bcf2dda12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:47.707762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 28/59] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:43:47.731814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915d1f8-5bfa-40a3-a0a1-e35ae110909f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:47.847540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915d1f8-5bfa-40a3-a0a1-e35ae110909f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:47.880920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11e65d-f871-45a8-9318-030ee3f02be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:47.881716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e65d-f871-45a8-9318-030ee3f02be0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:47.882004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e65d-f871-45a8-9318-030ee3f02be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:47.882280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e65d-f871-45a8-9318-030ee3f02be0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:47.883522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e65d-f871-45a8-9318-030ee3f02be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:47.885009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e65d-f871-45a8-9318-030ee3f02be0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:47.886983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 32/60] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:47.892850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2e0a-f862-4eed-b9de-f08bcf2dda12 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:47.991980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2e0a-f862-4eed-b9de-f08bcf2dda12 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:48.026367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e725e7-8d3b-4825-9c76-5c7fe6da28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:48.027047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e725e7-8d3b-4825-9c76-5c7fe6da28ba None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:48.027333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e725e7-8d3b-4825-9c76-5c7fe6da28ba None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:48.027612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e725e7-8d3b-4825-9c76-5c7fe6da28ba None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:48.028353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e725e7-8d3b-4825-9c76-5c7fe6da28ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:48.029850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e725e7-8d3b-4825-9c76-5c7fe6da28ba None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:48.060605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 29/61] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:43:47 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:51.307984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa118f-fe7d-4667-abd9-cc1e96ee8beb None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.308966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa118f-fe7d-4667-abd9-cc1e96ee8beb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.309454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa118f-fe7d-4667-abd9-cc1e96ee8beb None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.311022 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 33/62] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:51.316731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9314a96-0378-41ad-8340-de47ee1c61ba None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.317539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9314a96-0378-41ad-8340-de47ee1c61ba None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.317995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9314a96-0378-41ad-8340-de47ee1c61ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.341693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d9314a96-0378-41ad-8340-de47ee1c61ba None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:51.343207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d9314a96-0378-41ad-8340-de47ee1c61ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:51.432696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 30/63] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:51.472543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa118f-fe7d-4667-abd9-cc1e96ee8beb None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:51.594682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa118f-fe7d-4667-abd9-cc1e96ee8beb None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:51.613744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba03f88-392c-4508-91cc-8a41ac38d59a None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.614323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba03f88-392c-4508-91cc-8a41ac38d59a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.614781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba03f88-392c-4508-91cc-8a41ac38d59a None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.616462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 31/64] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:43:51.622439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f7cbd-9686-4187-b80b-910e93d04bc4 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.623046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f7cbd-9686-4187-b80b-910e93d04bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.623510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f7cbd-9686-4187-b80b-910e93d04bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.652144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1d5f7cbd-9686-4187-b80b-910e93d04bc4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:51.655431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1d5f7cbd-9686-4187-b80b-910e93d04bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:51.675414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:51.676600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.677124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.677597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.692962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:51.702371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:51.703314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:51.704154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:43:51.706916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 34/65] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:51.713722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:51.769921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 32/66] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:43:51.804726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f7cbd-9686-4187-b80b-910e93d04bc4 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:51.844648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae361e-7a56-4ba0-9159-41bd999c9667 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:51.880401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a9a0b-ae3c-4704-8365-095f654bb653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:51.881131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a9a0b-ae3c-4704-8365-095f654bb653 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.881588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a9a0b-ae3c-4704-8365-095f654bb653 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.882027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a9a0b-ae3c-4704-8365-095f654bb653 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.882969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a9a0b-ae3c-4704-8365-095f654bb653 None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:51.883289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a9a0b-ae3c-4704-8365-095f654bb653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:51.884766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a9a0b-ae3c-4704-8365-095f654bb653 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:51.894466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 35/67] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:51.895726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559c2c-dc41-427f-ad47-d2c915fe11e2 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.896060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559c2c-dc41-427f-ad47-d2c915fe11e2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.896349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559c2c-dc41-427f-ad47-d2c915fe11e2 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.897850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 36/68] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:51.899718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23035c-d02f-4c52-bc9c-8538eaddfe50 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.899718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23035c-d02f-4c52-bc9c-8538eaddfe50 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.899718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23035c-d02f-4c52-bc9c-8538eaddfe50 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.901282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 37/69] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:51.902259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23035c-d02f-4c52-bc9c-8538eaddfe50 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:51.934806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f7cbd-9686-4187-b80b-910e93d04bc4 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:51.970873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac1e7-4691-44aa-8cf0-77064091ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:51.971705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac1e7-4691-44aa-8cf0-77064091ff47 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.971991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac1e7-4691-44aa-8cf0-77064091ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.972270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac1e7-4691-44aa-8cf0-77064091ff47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:51.982272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ac1e7-4691-44aa-8cf0-77064091ff47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-6a2ac1e7-4691-44aa-8cf0-77064091ff47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:51.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:51.991376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 33/70] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:43:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:43:51.997087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc2523-e34e-45c0-aa2d-560d12ba4fcf None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:51.997780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc2523-e34e-45c0-aa2d-560d12ba4fcf None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:51.997780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc2523-e34e-45c0-aa2d-560d12ba4fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.005867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23035c-d02f-4c52-bc9c-8538eaddfe50 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.014011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c5bc2523-e34e-45c0-aa2d-560d12ba4fcf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:52.015388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c5bc2523-e34e-45c0-aa2d-560d12ba4fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:52.039677 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126bc98-c509-4f6b-8388-eba60b4fde22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.040611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126bc98-c509-4f6b-8388-eba60b4fde22 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.040952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126bc98-c509-4f6b-8388-eba60b4fde22 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.041228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126bc98-c509-4f6b-8388-eba60b4fde22 None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.056586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126bc98-c509-4f6b-8388-eba60b4fde22 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:52.058284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126bc98-c509-4f6b-8388-eba60b4fde22 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:52.060174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 38/71] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:51 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:52.061680 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2416234-c40e-4e55-96de-d5ff7fea60ef None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.062144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2416234-c40e-4e55-96de-d5ff7fea60ef None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.062589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2416234-c40e-4e55-96de-d5ff7fea60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.080491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-d2416234-c40e-4e55-96de-d5ff7fea60ef None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:52.081722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d2416234-c40e-4e55-96de-d5ff7fea60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:52.090619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 34/72] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:52.091489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc2523-e34e-45c0-aa2d-560d12ba4fcf None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.150876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 39/73] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:52.151753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2416234-c40e-4e55-96de-d5ff7fea60ef None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.196660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc2523-e34e-45c0-aa2d-560d12ba4fcf None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.230529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627f6ed-b3eb-4140-bf8f-c4bea505840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.231221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627f6ed-b3eb-4140-bf8f-c4bea505840b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.231503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627f6ed-b3eb-4140-bf8f-c4bea505840b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.231782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627f6ed-b3eb-4140-bf8f-c4bea505840b None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.232549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627f6ed-b3eb-4140-bf8f-c4bea505840b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:52.232891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627f6ed-b3eb-4140-bf8f-c4bea505840b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:52.234437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627f6ed-b3eb-4140-bf8f-c4bea505840b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:52.243288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 35/74] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:52.244512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406b7a3-c003-44d1-8d11-61eb4796ee3e None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.244838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406b7a3-c003-44d1-8d11-61eb4796ee3e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.245116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406b7a3-c003-44d1-8d11-61eb4796ee3e None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.246354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 36/75] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:52.248243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406b7a3-c003-44d1-8d11-61eb4796ee3e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.257477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2416234-c40e-4e55-96de-d5ff7fea60ef None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.290926 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.291581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.291868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.292152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.353615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406b7a3-c003-44d1-8d11-61eb4796ee3e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.358841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:52.361650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:52.387712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.388529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.388844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.389120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.399300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:52.406902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:52.407901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:52.408735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:52.414073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 37/76] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:52.414073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.466275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 40/77] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:43:52.467155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.516513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c8c00-314d-4069-9e71-e652991b84d5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.550397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86dea3-c2f2-4392-a399-cb978a874d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.551215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86dea3-c2f2-4392-a399-cb978a874d15 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.551500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86dea3-c2f2-4392-a399-cb978a874d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.551783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86dea3-c2f2-4392-a399-cb978a874d15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.561385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86dea3-c2f2-4392-a399-cb978a874d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:52.562961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4995-b4bd-4ead-a366-1009b41b5057 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-fe86dea3-c2f2-4392-a399-cb978a874d15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:52.569292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:52.570296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:52.571058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 38/78] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:52.571687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b81d02-fb6c-46ba-b3b8-dc31e6e0cb59 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.572223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b81d02-fb6c-46ba-b3b8-dc31e6e0cb59 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.572223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b81d02-fb6c-46ba-b3b8-dc31e6e0cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.590622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-80b81d02-fb6c-46ba-b3b8-dc31e6e0cb59 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:52.591846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-80b81d02-fb6c-46ba-b3b8-dc31e6e0cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:52.597307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.598174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.598459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.598737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.599932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:52.601424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:52.603083 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 41/79] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:52.608195 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.661501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 39/80] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:52.662299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b81d02-fb6c-46ba-b3b8-dc31e6e0cb59 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.706030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae1e5-708d-411c-8108-85154f0ea21a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.740500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.741207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.741497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.741778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.742543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:52.742857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:52.744261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:52.753959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 42/81] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:52.754768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.770405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b81d02-fb6c-46ba-b3b8-dc31e6e0cb59 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.802148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.803023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.803310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.803586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.804792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:52.806267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:52.808029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 40/82] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:52.808832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.859600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bad8-b141-48d3-99a0-2e3db79bce1f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.894093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.894776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.895062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.895341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:52.896105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:52.896418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:52.897832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:52.905863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 43/83] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:52.906672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:52.907273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872a4d-d044-4d24-890f-8beabb15edca None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:52.940071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:52.940634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:52.940949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:52.941234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.007962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e89c5-7bbe-4ba0-ae22-2d2ede3e805c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.009306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.010770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.041294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.042155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.042432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.042707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.043906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.045381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.047057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 44/84] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:53.047821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.114975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 41/85] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:43:53.115853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.150508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2dd55-5068-4fbd-be4d-d6d3cc578ab2 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.183670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.184550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.184870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.185150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] PATH_INFO: `/v3/users/7ac1c607394142e496b17c3444cb39d5` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.186361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] RBAC: Authorizing `identity:get_user(user_id=7ac1c607394142e496b17c3444cb39d5)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.187877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.189571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 45/86] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/users/7ac1c607394142e496b17c3444cb39d5 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:53.190396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.208840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a0892-e5bb-4ee6-a404-d9bd041df193 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.243100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.243781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.244068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.244331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.245210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=0dc039f6005b420e807bfb06c480aa30) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:53.245530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.247037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.252454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 42/87] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/role_assignments?user.id=0dc039f6005b420e807bfb06c480aa30&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=e7ad4f242602439f80a3999084d931dd => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:53.253248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.303982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514ce6-06fb-43a7-85f8-3409c317175e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.339634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.340544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.340864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.341145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.342424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.344017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.350822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 46/88] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:53.350822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.357292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd77e-7476-4e98-8ed3-46bfeabb14cf None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.391046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.391744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.392033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.392297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.393052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.394551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.418678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 43/89] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:43:53 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:53.419544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.453310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b570-f95b-4a3f-955c-741839e406f5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.491421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.492394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.492785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.493074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.494555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.496260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.498363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 47/90] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:53.504394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.531957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c53ce4-279c-45c6-aac0-e1fb73b06823 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.567721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.568411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.568719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.569003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.615462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bacc08-ddab-4e28-abe8-f16b0aa4bb29 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.641911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.643388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.652853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.653527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.653816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.654098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.722885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.724257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.747712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 44/91] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:43:53.748586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.853996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5baf0-d437-4014-bfa5-c94851614b88 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:53.857998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 48/92] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:43:53.859170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.889730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:53.890446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:53.890730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:53.891001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:53.891830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] RBAC: Adding query filter params (role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=0dc039f6005b420e807bfb06c480aa30) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:53.892138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:53.893642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:53.899171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 45/93] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/role_assignments?user.id=0dc039f6005b420e807bfb06c480aa30&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:53.899962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:53.975424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28064e8-0221-4dd1-ae9a-6b00ed4ece04 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:54.000827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441be16b-5121-40f5-93ba-68dac25519a8 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:54.012147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:54.013466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:54.013981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:54.014473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:54.016093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:54.018029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:54.024820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 49/94] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:54.026951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:54.036241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:54.037411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:54.037629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:54.037715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] PATH_INFO: `/v3/projects/948c03d537dc4de9ae4aa0aea41ca852` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:54.039011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] RBAC: Authorizing `identity:get_project(project_id=948c03d537dc4de9ae4aa0aea41ca852)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:54.040627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:54.042751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 46/95] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:53 2022] GET /identity/v3/projects/948c03d537dc4de9ae4aa0aea41ca852 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:54.048632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:54.134511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b278b8-54fe-4ea6-8708-230c3cac068e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:54.157663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f43e89-4c95-4cc6-bb32-08432ac29238 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:54.170913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcebdb5-78e5-4515-8470-8d23636f5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:54.172036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebdb5-78e5-4515-8470-8d23636f5409 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:54.172520 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebdb5-78e5-4515-8470-8d23636f5409 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:54.173038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebdb5-78e5-4515-8470-8d23636f5409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:54.174087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcebdb5-78e5-4515-8470-8d23636f5409 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=7ac1c607394142e496b17c3444cb39d5) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:54.174597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcebdb5-78e5-4515-8470-8d23636f5409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:54.176308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcebdb5-78e5-4515-8470-8d23636f5409 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:54.185727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 50/96] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:43:54 2022] GET /identity/v3/role_assignments?user.id=7ac1c607394142e496b17c3444cb39d5&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:43:54.198396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604f1d6-f157-4e6a-87f9-177ee0902f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:54.199085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f1d6-f157-4e6a-87f9-177ee0902f95 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:54.199373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f1d6-f157-4e6a-87f9-177ee0902f95 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:54.199651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f1d6-f157-4e6a-87f9-177ee0902f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:54.200537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604f1d6-f157-4e6a-87f9-177ee0902f95 None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=948c03d537dc4de9ae4aa0aea41ca852, user.id=0dc039f6005b420e807bfb06c480aa30) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:54.200887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604f1d6-f157-4e6a-87f9-177ee0902f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:54.202434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604f1d6-f157-4e6a-87f9-177ee0902f95 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:54.209303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 47/97] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:43:54 2022] GET /identity/v3/role_assignments?user.id=0dc039f6005b420e807bfb06c480aa30&scope.project.id=948c03d537dc4de9ae4aa0aea41ca852&role.id=e7ad4f242602439f80a3999084d931dd => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:43:56.623774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592bf9f-95a2-416d-894a-4b5d589faae6 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:56.624882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592bf9f-95a2-416d-894a-4b5d589faae6 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:56.625376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592bf9f-95a2-416d-894a-4b5d589faae6 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:56.626991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 51/98] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:56.632601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa3977-d43b-4f22-a7f2-44a58caa52ee None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:56.633064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa3977-d43b-4f22-a7f2-44a58caa52ee None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:56.633243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa3977-d43b-4f22-a7f2-44a58caa52ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:56.654193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-bbaa3977-d43b-4f22-a7f2-44a58caa52ee None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:56.655385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-bbaa3977-d43b-4f22-a7f2-44a58caa52ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:56.671282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41128f-8fc7-45b0-8ad8-82349b898eda None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:56.671655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41128f-8fc7-45b0-8ad8-82349b898eda None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:56.671945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41128f-8fc7-45b0-8ad8-82349b898eda None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:56.675245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 52/99] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:56.679334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39a45-bcdd-4cba-b3b5-a46a1867401b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:56.679630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39a45-bcdd-4cba-b3b5-a46a1867401b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:56.679920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39a45-bcdd-4cba-b3b5-a46a1867401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:56.713857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a0f39a45-bcdd-4cba-b3b5-a46a1867401b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:56.715001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a0f39a45-bcdd-4cba-b3b5-a46a1867401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:56.779155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 48/100] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:56.816690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa3977-d43b-4f22-a7f2-44a58caa52ee None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:56.822094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 53/101] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:43:56.859274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f39a45-bcdd-4cba-b3b5-a46a1867401b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:56.969742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa3977-d43b-4f22-a7f2-44a58caa52ee None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.028349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c053a9-43c4-4f9c-a1a9-298757fcfea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.029205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c053a9-43c4-4f9c-a1a9-298757fcfea3 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.029492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c053a9-43c4-4f9c-a1a9-298757fcfea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.029758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c053a9-43c4-4f9c-a1a9-298757fcfea3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.050984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c053a9-43c4-4f9c-a1a9-298757fcfea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-30c053a9-43c4-4f9c-a1a9-298757fcfea3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:57.060297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:57.061195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:43:57.062015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:57.063893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 49/102] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:43:57.065359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373993-4e45-4037-b9b2-870d95c848d1 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.065654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373993-4e45-4037-b9b2-870d95c848d1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.065950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373993-4e45-4037-b9b2-870d95c848d1 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.067256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 50/103] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:57.074694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8373993-4e45-4037-b9b2-870d95c848d1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:57.107485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f39a45-bcdd-4cba-b3b5-a46a1867401b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.144889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095104b-c160-4982-84f1-ca7658f5db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.146154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095104b-c160-4982-84f1-ca7658f5db37 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.146441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095104b-c160-4982-84f1-ca7658f5db37 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.146723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095104b-c160-4982-84f1-ca7658f5db37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.148071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095104b-c160-4982-84f1-ca7658f5db37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:57.149939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095104b-c160-4982-84f1-ca7658f5db37 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:57.151807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 54/104] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:57.153181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1aa1-e7a8-4011-a390-1cf1d6489434 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.153478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1aa1-e7a8-4011-a390-1cf1d6489434 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.153750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1aa1-e7a8-4011-a390-1cf1d6489434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.173592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2b6e1aa1-e7a8-4011-a390-1cf1d6489434 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:57.175477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2b6e1aa1-e7a8-4011-a390-1cf1d6489434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:57.285530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8373993-4e45-4037-b9b2-870d95c848d1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.301042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 55/105] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:57.301918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1aa1-e7a8-4011-a390-1cf1d6489434 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:57.370855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20899d3-59b0-40de-8553-9083b5da30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.371544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20899d3-59b0-40de-8553-9083b5da30c2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.371825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20899d3-59b0-40de-8553-9083b5da30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.372100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20899d3-59b0-40de-8553-9083b5da30c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.372908 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20899d3-59b0-40de-8553-9083b5da30c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:57.373220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20899d3-59b0-40de-8553-9083b5da30c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:57.374670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20899d3-59b0-40de-8553-9083b5da30c2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:57.384492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 51/106] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:57.386484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75b45-d462-4599-8533-56bc5a4b0c1e None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.386964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75b45-d462-4599-8533-56bc5a4b0c1e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.387425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75b45-d462-4599-8533-56bc5a4b0c1e None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.392796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 52/107] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:57.393817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75b45-d462-4599-8533-56bc5a4b0c1e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:57.458172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1aa1-e7a8-4011-a390-1cf1d6489434 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.490791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.491462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.491741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.492021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.492758 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:57.494212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:57.499377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75b45-d462-4599-8533-56bc5a4b0c1e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.522114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 56/108] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:43:57 2022] POST /identity/v3/projects => generated 302 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:43:57.522826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:57.545473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47532467-0089-4365-afa1-79476db64792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.546201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532467-0089-4365-afa1-79476db64792 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.546572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532467-0089-4365-afa1-79476db64792 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.546847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532467-0089-4365-afa1-79476db64792 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.564322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47532467-0089-4365-afa1-79476db64792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-47532467-0089-4365-afa1-79476db64792 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:57.574682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:57.575612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:57.576408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:57.583762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 53/109] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:57.583762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af9f2d-deb6-4f51-9eec-503ac0ea417b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.583762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af9f2d-deb6-4f51-9eec-503ac0ea417b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.583762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af9f2d-deb6-4f51-9eec-503ac0ea417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.607021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-81af9f2d-deb6-4f51-9eec-503ac0ea417b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:57.608614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-81af9f2d-deb6-4f51-9eec-503ac0ea417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:57.647448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff0ca-f229-4941-b015-d57b8cb715ef None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.688700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c9704-77f7-4d07-ad4d-2ac2dfe5fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.688904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 54/110] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:57.689309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9704-77f7-4d07-ad4d-2ac2dfe5fd94 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.689309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9704-77f7-4d07-ad4d-2ac2dfe5fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.689309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9704-77f7-4d07-ad4d-2ac2dfe5fd94 None admin] PATH_INFO: `/v3/users/5028192a75ba45f892a8c64447aa1aa9` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.689508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35a61-b9af-466a-80b2-63ff6c13423b None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.689508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35a61-b9af-466a-80b2-63ff6c13423b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.689508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35a61-b9af-466a-80b2-63ff6c13423b None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.689508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 55/111] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:57.689508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35a61-b9af-466a-80b2-63ff6c13423b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:57.709849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c9704-77f7-4d07-ad4d-2ac2dfe5fd94 None admin] RBAC: Authorizing `identity:get_user(user_id=5028192a75ba45f892a8c64447aa1aa9)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:57.711346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c9704-77f7-4d07-ad4d-2ac2dfe5fd94 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:57.713152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 57/112] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:57 2022] GET /identity/v3/users/5028192a75ba45f892a8c64447aa1aa9 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:57.714424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41fbb-8a9e-47eb-9d7d-b9f77abed3cb None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.714709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41fbb-8a9e-47eb-9d7d-b9f77abed3cb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.714990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41fbb-8a9e-47eb-9d7d-b9f77abed3cb None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.716224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 58/113] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:43:57.720637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f920-ee7c-4167-b827-5ad2d98faff5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.720971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f920-ee7c-4167-b827-5ad2d98faff5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.721255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f920-ee7c-4167-b827-5ad2d98faff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.738337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b315f920-ee7c-4167-b827-5ad2d98faff5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:57.739548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b315f920-ee7c-4167-b827-5ad2d98faff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:57.802339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35a61-b9af-466a-80b2-63ff6c13423b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.817394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 59/114] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:57.821985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315f920-ee7c-4167-b827-5ad2d98faff5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:57.835185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.835900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.836184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.836473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.837275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] RBAC: Adding query filter params (name=member) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:57.837762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:57.839250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:57.848736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 56/115] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:57.848736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:57.922542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315f920-ee7c-4167-b827-5ad2d98faff5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.949338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57146ba-6405-4c91-b66a-f0fb843ecc90 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:57.955991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fb3a3-422b-410c-aa1e-f5f47dfd4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.957062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb3a3-422b-410c-aa1e-f5f47dfd4609 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.957504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb3a3-422b-410c-aa1e-f5f47dfd4609 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.957941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb3a3-422b-410c-aa1e-f5f47dfd4609 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.968202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fb3a3-422b-410c-aa1e-f5f47dfd4609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-cc8fb3a3-422b-410c-aa1e-f5f47dfd4609 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:57.975853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:57.976993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:43:57.977753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 60/116] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:57.978375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338634-b8e1-47cd-af97-5ba1190637c7 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.978951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338634-b8e1-47cd-af97-5ba1190637c7 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.978951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338634-b8e1-47cd-af97-5ba1190637c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.987681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:57.988344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:57.988646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:57.988936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:57.995136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-84338634-b8e1-47cd-af97-5ba1190637c7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:43:57.996332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-84338634-b8e1-47cd-af97-5ba1190637c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:43:58.057414 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.059126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.065247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 61/117] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:43:58.068633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84338634-b8e1-47cd-af97-5ba1190637c7 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.157300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 57/118] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:43:58.162057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.168571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84338634-b8e1-47cd-af97-5ba1190637c7 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.200963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.203892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.204154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.204627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.216165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:58.224384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:58.225327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:43:58.226115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:43:58.226717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 62/119] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:58.231691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.258830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353479-adc0-4544-92b4-05e006bac294 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.292150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.293104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.293358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.293636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.294912 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.296437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.298387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 58/120] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.298954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.337280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0128d9-2f38-412a-bc2c-e16e6eb25719 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.371567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.372256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.372537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.372843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.373608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:58.373918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.375445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.384058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 63/121] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.384693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.399695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e8d72-adfd-4314-976e-34b6b63ff740 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.432417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.433325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.433617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.433929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.443815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:43:58.451837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:43:58.452766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:43:58.453535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 59/122] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:43:58.454261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.495147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb672e7e-a1f1-45cd-a451-81cc806c1df5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.534048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.535190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.535483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.535765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.537607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.539098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 64/123] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.542016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.559577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c350c3-ffc4-4759-913c-66c1d37ea71d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.592171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.592822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.593136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.593570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.594331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:58.594645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.596045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.604474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 60/124] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.605299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.644693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97987b-24ec-400d-a089-a91a96d8c7b4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.678087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.679063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.679350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.679630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.680950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.682431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.689121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 65/125] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.689121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.703854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1360619-e710-4fe4-a3b8-0f73c42b10c5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.736552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.737496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.737785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.738064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.739283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.740778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.746832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 61/126] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.746832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.786949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41c7ca-fe19-4ccc-9494-9d144260ecb9 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.825061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.825781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.826026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.826302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.827056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:58.827371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.828895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.837467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 66/127] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.838620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.840267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3839ad0-d5fd-4763-9baa-2966b0024afd None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.873138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.873808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.874090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.874382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.875219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] RBAC: Adding query filter params (role.id=e0d63a4c4aae4c998504ffee4b2664be, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=5028192a75ba45f892a8c64447aa1aa9) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:43:58.875529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.876984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.882203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 62/128] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/role_assignments?user.id=5028192a75ba45f892a8c64447aa1aa9&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=e0d63a4c4aae4c998504ffee4b2664be => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.882966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:58.949287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef833a3-1e52-4009-bb73-7c24bff6a86b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.985003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:58.985923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:58.986209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:58.986485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] PATH_INFO: `/v3/users/7ac1c607394142e496b17c3444cb39d5` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:58.987664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929350eb-7683-40de-a4fb-3cf1f45bc62a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:58.987892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] RBAC: Authorizing `identity:get_user(user_id=7ac1c607394142e496b17c3444cb39d5)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:58.989358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:58.991102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 67/129] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/users/7ac1c607394142e496b17c3444cb39d5 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:58.996562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:59.023586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.024570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.024887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.025165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/0dc039f6005b420e807bfb06c480aa30/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.027402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] RBAC: Authorizing `identity:create_grant(project_id=53a50937bcf747f58de9c47b2be53f10, user_id=0dc039f6005b420e807bfb06c480aa30, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.028988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.047025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 63/130] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:43:58 2022] PUT /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/0dc039f6005b420e807bfb06c480aa30/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:43:59.047716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:59.130559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53efa26-9166-4a18-bbc8-af7c0cb7bedc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:59.166993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.167895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.168179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.168521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] PATH_INFO: `/v3/projects/948c03d537dc4de9ae4aa0aea41ca852` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.170019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=948c03d537dc4de9ae4aa0aea41ca852)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.171747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.174294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 68/131] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:58 2022] GET /identity/v3/projects/948c03d537dc4de9ae4aa0aea41ca852 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:59.174989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:59.286865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1652-84fc-4fb2-ad01-cf41c4c17e0e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:59.290737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd864863-d66f-4c23-97c1-d4bcf616f9a5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:59.328313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.329450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.329735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.330013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.331463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.332992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.335447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 69/132] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:59 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:59.335992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:59.363562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.364466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.364774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.365050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.366259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.367709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.369690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 64/133] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:43:59 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:59.370460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:59.462009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa231255-0298-4f84-85d0-7c7a25983581 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:59.479667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe392-06b4-4c3a-b9da-a3907242ae02 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:59.496272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.497268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.497546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.497823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] PATH_INFO: `/v3/projects/948c03d537dc4de9ae4aa0aea41ca852/users/0dc039f6005b420e807bfb06c480aa30/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.499937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] RBAC: Authorizing `identity:create_grant(project_id=948c03d537dc4de9ae4aa0aea41ca852, user_id=0dc039f6005b420e807bfb06c480aa30, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.501497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.523356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.525008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.525278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.525556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/7ac1c607394142e496b17c3444cb39d5/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.526926 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 70/134] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:43:59 2022] PUT /identity/v3/projects/948c03d537dc4de9ae4aa0aea41ca852/users/0dc039f6005b420e807bfb06c480aa30/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:43:59.527501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:59.530556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] RBAC: Authorizing `identity:create_grant(project_id=53a50937bcf747f58de9c47b2be53f10, user_id=7ac1c607394142e496b17c3444cb39d5, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.533786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.557654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 65/135] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:43:59 2022] PUT /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/7ac1c607394142e496b17c3444cb39d5/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:43:59.661029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1154-cd52-4d6e-82b3-5be8be8a3022 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:59.698285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1a945-e4a9-46c0-b62b-26448ae8fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.699259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1a945-e4a9-46c0-b62b-26448ae8fdde None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.699546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1a945-e4a9-46c0-b62b-26448ae8fdde None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.699862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1a945-e4a9-46c0-b62b-26448ae8fdde None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.701302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1a945-e4a9-46c0-b62b-26448ae8fdde None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.702944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1a945-e4a9-46c0-b62b-26448ae8fdde None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.705065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 71/136] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:43:59 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:43:59.711263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:43:59.821966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e7b5-a6d3-4d46-88f2-020c26e0e045 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:43:59.858621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4c2ae-a329-4059-a775-a8ff8851e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:43:59.859657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c2ae-a329-4059-a775-a8ff8851e334 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:43:59.859945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c2ae-a329-4059-a775-a8ff8851e334 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:43:59.861690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c2ae-a329-4059-a775-a8ff8851e334 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/0dc039f6005b420e807bfb06c480aa30/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:43:59.869543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4c2ae-a329-4059-a775-a8ff8851e334 None admin] RBAC: Authorizing `identity:create_grant(project_id=53a50937bcf747f58de9c47b2be53f10, user_id=0dc039f6005b420e807bfb06c480aa30, role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:43:59.871147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4c2ae-a329-4059-a775-a8ff8851e334 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:43:59.909729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 66/137] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:43:59 2022] PUT /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/0dc039f6005b420e807bfb06c480aa30/roles/08dee391f7e34431ad610ccbb9b49349 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:00.146057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4ce5e-3c60-4771-9ad1-2ce510100bd4 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:00.146436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4ce5e-3c60-4771-9ad1-2ce510100bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:00.146639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4ce5e-3c60-4771-9ad1-2ce510100bd4 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:00.148351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 72/138] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:00.161683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb080628-6dbd-4c6f-9e8e-0d935be59c89 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:00.162018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb080628-6dbd-4c6f-9e8e-0d935be59c89 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:00.162254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb080628-6dbd-4c6f-9e8e-0d935be59c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:00.181777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-bb080628-6dbd-4c6f-9e8e-0d935be59c89 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:00.183004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-bb080628-6dbd-4c6f-9e8e-0d935be59c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:00.257371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 67/139] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:00.290538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4ce5e-3c60-4771-9ad1-2ce510100bd4 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:00.417408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4ce5e-3c60-4771-9ad1-2ce510100bd4 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:00.470264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd910e-29ee-4331-8c92-ed0295e8471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:00.471081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd910e-29ee-4331-8c92-ed0295e8471e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:00.471353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd910e-29ee-4331-8c92-ed0295e8471e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:00.471635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd910e-29ee-4331-8c92-ed0295e8471e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:00.472924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd910e-29ee-4331-8c92-ed0295e8471e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:00.474361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd910e-29ee-4331-8c92-ed0295e8471e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:00.476200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 73/140] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:00.481645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb080628-6dbd-4c6f-9e8e-0d935be59c89 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:00.604102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb080628-6dbd-4c6f-9e8e-0d935be59c89 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:00.637340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c51d-c1f1-4f4a-8478-cfbe36d91645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:00.638030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c51d-c1f1-4f4a-8478-cfbe36d91645 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:00.638318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c51d-c1f1-4f4a-8478-cfbe36d91645 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:00.638590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c51d-c1f1-4f4a-8478-cfbe36d91645 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:00.639303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c51d-c1f1-4f4a-8478-cfbe36d91645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:00.641157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c51d-c1f1-4f4a-8478-cfbe36d91645 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:00.671307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 68/141] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:00 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:01.596354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebbe0-1a75-48d0-8426-3b4604e7042e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:01.596900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebbe0-1a75-48d0-8426-3b4604e7042e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:01.596975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebbe0-1a75-48d0-8426-3b4604e7042e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:01.598301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 74/142] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:01.604001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5ce3-c9a2-4729-90a0-7203d6ce464a None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:01.604478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5ce3-c9a2-4729-90a0-7203d6ce464a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:01.604578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5ce3-c9a2-4729-90a0-7203d6ce464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:01.623638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-640c5ce3-c9a2-4729-90a0-7203d6ce464a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:01.624947 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-640c5ce3-c9a2-4729-90a0-7203d6ce464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:01.707124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 69/143] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:01.729905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cebbe0-1a75-48d0-8426-3b4604e7042e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:01.839491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cebbe0-1a75-48d0-8426-3b4604e7042e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:01.875290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:01.876108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:01.876397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:01.876668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:01.887491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:01.895360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:01.896240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:01.897060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 75/144] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:01.902488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5ce3-c9a2-4729-90a0-7203d6ce464a None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:02.005546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5ce3-c9a2-4729-90a0-7203d6ce464a None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:02.039354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:02.040146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:02.040364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:02.040702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:02.041471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:02.041779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:02.043162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:02.051986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 70/145] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:02.057714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:02.160816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c707ab6-01b6-4e43-9445-d7ffa0f20151 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:02.193151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:02.194094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:02.194377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:02.194698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] PATH_INFO: `/v3/users/5028192a75ba45f892a8c64447aa1aa9` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:02.200351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] RBAC: Authorizing `identity:get_user(user_id=5028192a75ba45f892a8c64447aa1aa9)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:02.201843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:02.203726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 76/146] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:02 2022] GET /identity/v3/users/5028192a75ba45f892a8c64447aa1aa9 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:02.209151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:02.317394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc0eb3-bc7e-4bd0-9973-af97ea3a64e9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:02.358361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9aa43-f112-4a76-a430-21e4c5b96895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:02.359282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9aa43-f112-4a76-a430-21e4c5b96895 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:02.359563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9aa43-f112-4a76-a430-21e4c5b96895 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:02.359835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9aa43-f112-4a76-a430-21e4c5b96895 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:02.365498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9aa43-f112-4a76-a430-21e4c5b96895 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:02.367020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9aa43-f112-4a76-a430-21e4c5b96895 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:02.368969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 71/147] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:02 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:02.374596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:02.482620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d50d2-dbe3-464d-b467-8a275b694760 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:02.516751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dce0b1-c36e-4513-a117-9c5d8e8ca964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:02.517615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dce0b1-c36e-4513-a117-9c5d8e8ca964 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:02.517899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dce0b1-c36e-4513-a117-9c5d8e8ca964 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:02.518170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dce0b1-c36e-4513-a117-9c5d8e8ca964 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/5028192a75ba45f892a8c64447aa1aa9/roles/e0d63a4c4aae4c998504ffee4b2664be` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:02.520249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dce0b1-c36e-4513-a117-9c5d8e8ca964 None admin] RBAC: Authorizing `identity:create_grant(project_id=53a50937bcf747f58de9c47b2be53f10, user_id=5028192a75ba45f892a8c64447aa1aa9, role_id=e0d63a4c4aae4c998504ffee4b2664be)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:02.521780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dce0b1-c36e-4513-a117-9c5d8e8ca964 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:02.543224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 77/148] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:02 2022] PUT /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10/users/5028192a75ba45f892a8c64447aa1aa9/roles/e0d63a4c4aae4c998504ffee4b2664be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:02.659918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2af3-0ede-4969-af63-ba5ce8485661 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:02.660438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2af3-0ede-4969-af63-ba5ce8485661 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:02.660438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2af3-0ede-4969-af63-ba5ce8485661 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:02.661877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 72/149] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:02.667667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6849a-b8f4-41d6-a3f5-844a09eef604 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:02.668122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6849a-b8f4-41d6-a3f5-844a09eef604 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:02.668215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6849a-b8f4-41d6-a3f5-844a09eef604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:02.689912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-fbf6849a-b8f4-41d6-a3f5-844a09eef604 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:02.691142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fbf6849a-b8f4-41d6-a3f5-844a09eef604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:02.781477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 78/150] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:02.806237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2af3-0ede-4969-af63-ba5ce8485661 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:02.918436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2af3-0ede-4969-af63-ba5ce8485661 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:02.960291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:02.961217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:02.961501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:02.961780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:02.972920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:02.980576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:02.981451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:02.982205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 73/151] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:02.988144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6849a-b8f4-41d6-a3f5-844a09eef604 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:03.086840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6849a-b8f4-41d6-a3f5-844a09eef604 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:03.124700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:03.124700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.124992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.128781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.128781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:03.128781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:03.128781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:03.138063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 79/152] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:03.143690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:03.288609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6224-d5e9-402b-be35-60ad5ee41c31 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:03.327729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e9e56-b8e6-4607-8863-81e32b0fc76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:03.328621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e9e56-b8e6-4607-8863-81e32b0fc76b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.328929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e9e56-b8e6-4607-8863-81e32b0fc76b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.329205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e9e56-b8e6-4607-8863-81e32b0fc76b None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.330502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e9e56-b8e6-4607-8863-81e32b0fc76b None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:03.331950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e9e56-b8e6-4607-8863-81e32b0fc76b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:03.333622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 74/153] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:03 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:03.339130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:03.443701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a82422-c98a-4dfa-9e6f-ebed8d6017ba None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:03.476941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cc6ef-43b8-4eaa-845d-2ad8bb998fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:03.477613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc6ef-43b8-4eaa-845d-2ad8bb998fe0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.477885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc6ef-43b8-4eaa-845d-2ad8bb998fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.478162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc6ef-43b8-4eaa-845d-2ad8bb998fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.516971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeef1a-101c-448e-ac78-7c737a8d5f2f None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.517293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeef1a-101c-448e-ac78-7c737a8d5f2f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.517530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeef1a-101c-448e-ac78-7c737a8d5f2f None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.518915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 75/154] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:03.524025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ec6a-70c2-4cdf-aeeb-52f108218ae3 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.524319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ec6a-70c2-4cdf-aeeb-52f108218ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.524604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ec6a-70c2-4cdf-aeeb-52f108218ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.549315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cc6ef-43b8-4eaa-845d-2ad8bb998fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:03.550726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cc6ef-43b8-4eaa-845d-2ad8bb998fe0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:03.558098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5c72ec6a-70c2-4cdf-aeeb-52f108218ae3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:03.559315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5c72ec6a-70c2-4cdf-aeeb-52f108218ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:03.651706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 80/155] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:03.657035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5072d7-8794-476f-b979-d2395b0c43fc None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.657378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5072d7-8794-476f-b979-d2395b0c43fc None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.657659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5072d7-8794-476f-b979-d2395b0c43fc None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.659138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 81/156] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:03.660749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5072d7-8794-476f-b979-d2395b0c43fc None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:03.720803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 76/157] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:03.722280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac10a-0a3a-44d9-9a0e-5668e3af1c9b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.722573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac10a-0a3a-44d9-9a0e-5668e3af1c9b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.722870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac10a-0a3a-44d9-9a0e-5668e3af1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.748518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b81ac10a-0a3a-44d9-9a0e-5668e3af1c9b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:03.749865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b81ac10a-0a3a-44d9-9a0e-5668e3af1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:03.769767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5072d7-8794-476f-b979-d2395b0c43fc None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:03.837087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:03.837851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:03.838129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:03.838457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:03.839819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:03.842595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:03.844523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 82/158] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:03 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:03.846163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:03.878321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 77/159] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:03.878719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac10a-0a3a-44d9-9a0e-5668e3af1c9b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.016664 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a32c-0b78-4c2b-aa27-49606a305226 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.075132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.076107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.076392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.076688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.090845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac10a-0a3a-44d9-9a0e-5668e3af1c9b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.092121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:04.101753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:04.102636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:04.103386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 83/160] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:04.108839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.182907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.183595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.183875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.184149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.185100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=0dc039f6005b420e807bfb06c480aa30) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:04.185409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:04.186890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:04.199864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 78/161] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:03 2022] GET /identity/v3/role_assignments?user.id=0dc039f6005b420e807bfb06c480aa30&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=e7ad4f242602439f80a3999084d931dd => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:04.200746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.221223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079f4de-61b7-48ce-97f0-fa11d679a5fe None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.261274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297afc0-5886-4931-b993-e1087ea33393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.262608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297afc0-5886-4931-b993-e1087ea33393 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.262891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297afc0-5886-4931-b993-e1087ea33393 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.263324 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297afc0-5886-4931-b993-e1087ea33393 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.275711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297afc0-5886-4931-b993-e1087ea33393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-8297afc0-5886-4931-b993-e1087ea33393 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:04.285086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:04.287423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 84/162] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:04.289449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397abce-ed6d-4d03-880d-a4b458859659 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.291099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397abce-ed6d-4d03-880d-a4b458859659 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.291099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397abce-ed6d-4d03-880d-a4b458859659 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.291099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 85/163] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:04.296135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606620-3762-4c66-9406-8d3ef7e876be None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.296641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606620-3762-4c66-9406-8d3ef7e876be None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.296944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606620-3762-4c66-9406-8d3ef7e876be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.325970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-23606620-3762-4c66-9406-8d3ef7e876be None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:04.327226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-23606620-3762-4c66-9406-8d3ef7e876be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:04.423835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 86/164] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:04.425420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23606620-3762-4c66-9406-8d3ef7e876be None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.431976 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65a804-c9cd-474e-8aa0-d54ab3e69392 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.465073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.466111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.466630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.467093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.468256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:04.468784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:04.470428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:04.479129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 79/165] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:04.480186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.546386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23606620-3762-4c66-9406-8d3ef7e876be None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.580343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5bae-88eb-425e-bbe8-e7249aadeeb7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.595468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.596161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.596450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.596759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.597539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:04.597844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:04.599249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:04.611683 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 87/166] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:04.613495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.625697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.626900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.627368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.627884 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.645623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:04.653642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:04.654506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:04.655284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:04.657880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 80/167] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:04.658913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.759375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec45df-bd9d-47d0-a2f2-f4c9e7ffed02 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.795534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.797028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.797500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.797959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.799376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:04.801153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:04.803098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 81/168] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:04.804096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.815233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461992f8-fb36-4e97-aee3-62285d9630c7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.868249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.869195 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.869633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.869734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] PATH_INFO: `/v3/users/0dc039f6005b420e807bfb06c480aa30` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.873448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] RBAC: Authorizing `identity:get_user(user_id=0dc039f6005b420e807bfb06c480aa30)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:04.874957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:04.876795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 88/169] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/users/0dc039f6005b420e807bfb06c480aa30 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:04.877588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:04.913256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727901aa-b4ff-473d-b39c-ce8be82247e7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:04.947223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:04.948259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:04.948834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:04.949300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:04.950293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:04.950801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:04.952443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:04.962461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 82/170] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:04.963827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:05.025486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7f3c-d62c-485c-8868-5b56523a19f2 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.065169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ed6f8-14bd-4a65-b144-8279d2c757e8 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.082036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.082917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.083023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.083251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.100003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.101099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.101569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.102027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.164136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.165450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:05.176464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.178269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:05.260344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 89/171] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:05.261613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:05.275227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 83/172] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:05.276410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:05.356338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb701-05d5-40a2-8fe7-bdcddaf56952 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.370718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4ea9a-a939-4dc3-9b28-b9251247eef0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.401919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.402804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.403084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.403355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] PATH_INFO: `/v3/users/7ac1c607394142e496b17c3444cb39d5` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.404941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.406086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.406555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.407015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] PATH_INFO: `/v3/projects/948c03d537dc4de9ae4aa0aea41ca852` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.408403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] RBAC: Authorizing `identity:get_project(project_id=948c03d537dc4de9ae4aa0aea41ca852)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.409405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] RBAC: Authorizing `identity:get_user(user_id=7ac1c607394142e496b17c3444cb39d5)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.410316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:05.410862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:05.412494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 84/174] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:05 2022] GET /identity/v3/projects/948c03d537dc4de9ae4aa0aea41ca852 => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:05.412598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 90/174] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:05 2022] GET /identity/v3/users/7ac1c607394142e496b17c3444cb39d5 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:05.413298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:05.421403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:05.591812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086c0a-8e6e-43b3-bcea-113100b4647c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.604402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade7afe-8d56-4d8f-90c6-bad4aed314ec None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.629596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.630989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.631270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.631542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.632905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.634727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:05.637156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 91/175] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:05 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:05.637988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:05.662350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.663017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.663297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.663567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.664459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=948c03d537dc4de9ae4aa0aea41ca852, user.id=0dc039f6005b420e807bfb06c480aa30) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:05.664804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.666310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:05.672591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 85/176] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:05 2022] GET /identity/v3/role_assignments?user.id=0dc039f6005b420e807bfb06c480aa30&scope.project.id=948c03d537dc4de9ae4aa0aea41ca852&role.id=e7ad4f242602439f80a3999084d931dd => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:05.673442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:05.777224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c5a60-db04-469a-96e7-4393882de017 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.812097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.812434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.812768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.813043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.813881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] RBAC: Adding query filter params (role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=0dc039f6005b420e807bfb06c480aa30) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:05.814188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.815646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:05.824959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 86/177] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:05 2022] GET /identity/v3/role_assignments?user.id=0dc039f6005b420e807bfb06c480aa30&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:05.833008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2545-0bcd-4190-873d-ea479319b088 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:05.904454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5d49-4f5e-4ef5-ae1e-54f95949cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:05.905654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5d49-4f5e-4ef5-ae1e-54f95949cf0c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:05.906139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5d49-4f5e-4ef5-ae1e-54f95949cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:05.906640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5d49-4f5e-4ef5-ae1e-54f95949cf0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:05.993919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb5d49-4f5e-4ef5-ae1e-54f95949cf0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:05.995803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb5d49-4f5e-4ef5-ae1e-54f95949cf0c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:06.120875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 92/178] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:06.127520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:06.192940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c8cc-5781-47db-8dd5-1c67e81daa4d None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.193644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c8cc-5781-47db-8dd5-1c67e81daa4d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.194126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c8cc-5781-47db-8dd5-1c67e81daa4d None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.195733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 93/179] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:06.201441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09fda-8840-472a-8c2f-7ab3848698d3 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.201990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09fda-8840-472a-8c2f-7ab3848698d3 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.202522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09fda-8840-472a-8c2f-7ab3848698d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.224710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6db09fda-8840-472a-8c2f-7ab3848698d3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:06.226339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6db09fda-8840-472a-8c2f-7ab3848698d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:06.256483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223db9-7207-4f72-ac4c-768f604993f2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:06.291456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:06.292725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.292725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.293023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.294322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:06.295825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:06.298132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 87/180] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:06.304124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:06.335166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 94/181] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:06.376214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db09fda-8840-472a-8c2f-7ab3848698d3 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:06.410231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71001a3-9391-4846-8364-7b68db6d42af None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:06.447600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e1811-33b3-42f2-9c8b-fa5aafa1808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:06.448220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1811-33b3-42f2-9c8b-fa5aafa1808d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.448495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1811-33b3-42f2-9c8b-fa5aafa1808d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.448858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1811-33b3-42f2-9c8b-fa5aafa1808d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.449783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e1811-33b3-42f2-9c8b-fa5aafa1808d None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=7ac1c607394142e496b17c3444cb39d5) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:06.450091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e1811-33b3-42f2-9c8b-fa5aafa1808d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:06.451595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e1811-33b3-42f2-9c8b-fa5aafa1808d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:06.458707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 88/182] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/role_assignments?user.id=7ac1c607394142e496b17c3444cb39d5&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:06.544590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db09fda-8840-472a-8c2f-7ab3848698d3 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:06.549564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4de99-3de7-473d-a972-524b91a7b93c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.549840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4de99-3de7-473d-a972-524b91a7b93c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.550118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4de99-3de7-473d-a972-524b91a7b93c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.551851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 89/183] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:06.562357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827306e4-ee6b-487e-84b4-8d3db84ea0c0 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.562690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827306e4-ee6b-487e-84b4-8d3db84ea0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.562896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827306e4-ee6b-487e-84b4-8d3db84ea0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.587017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-827306e4-ee6b-487e-84b4-8d3db84ea0c0 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:06.588182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:06.588403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-827306e4-ee6b-487e-84b4-8d3db84ea0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:06.589055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.589346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.589614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.610466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:06.622421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:06.624653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:06.626596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 95/184] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:06.632756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:06.668340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 90/185] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:06.669553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef335187-306f-486e-a882-007000374d62 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.669838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef335187-306f-486e-a882-007000374d62 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.670111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef335187-306f-486e-a882-007000374d62 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.671527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 91/186] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:06.680761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686a1b-eae1-4359-a4a9-ac119f35089a None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.680761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686a1b-eae1-4359-a4a9-ac119f35089a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.680761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686a1b-eae1-4359-a4a9-ac119f35089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.702057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a0686a1b-eae1-4359-a4a9-ac119f35089a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:06.703441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a0686a1b-eae1-4359-a4a9-ac119f35089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:06.783700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced5cec-52d1-430f-92e9-8cef2d4b2ab1 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:06.787624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 92/187] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:06.789926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0686a1b-eae1-4359-a4a9-ac119f35089a None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:06.823504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:06.824836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.825261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.825712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.826479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:06.826930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:06.828773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:06.838452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 96/188] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:06.839164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:06.914073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0686a1b-eae1-4359-a4a9-ac119f35089a None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:06.945146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca532c4-fa35-457d-9e8c-555c4737c79b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:06.946586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:06.947404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.947690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.947964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.957698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:06.965205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:06.966254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 93/189] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:06.967233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:06.979296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2f73d-da51-4224-b556-4ed461a614ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:06.980103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2f73d-da51-4224-b556-4ed461a614ed None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.980382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2f73d-da51-4224-b556-4ed461a614ed None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.980693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2f73d-da51-4224-b556-4ed461a614ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.981935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2f73d-da51-4224-b556-4ed461a614ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:06.983376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2f73d-da51-4224-b556-4ed461a614ed None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:06.985069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 97/190] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:06.986211 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368b0e2-ee16-4d37-9704-d9983f0242be None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:06.986497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368b0e2-ee16-4d37-9704-d9983f0242be None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:06.986771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368b0e2-ee16-4d37-9704-d9983f0242be None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:06.987959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 98/191] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:06.988651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368b0e2-ee16-4d37-9704-d9983f0242be None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.062581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1c06a-f5e0-453e-b12d-8b9e4bff6fd7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.084541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368b0e2-ee16-4d37-9704-d9983f0242be None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.095369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.096253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.096532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.096837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] PATH_INFO: `/v3/users/34be00073f59496f8646081eb09fc413` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.110155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] RBAC: Authorizing `identity:get_user(user_id=34be00073f59496f8646081eb09fc413)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.111635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.113524 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 94/192] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/users/34be00073f59496f8646081eb09fc413 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:07.114092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.121980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd574a-29a8-49fb-bf04-dc0ce685074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.122659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd574a-29a8-49fb-bf04-dc0ce685074b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.122958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd574a-29a8-49fb-bf04-dc0ce685074b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.123216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd574a-29a8-49fb-bf04-dc0ce685074b None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.123977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd574a-29a8-49fb-bf04-dc0ce685074b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:07.124312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd574a-29a8-49fb-bf04-dc0ce685074b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.125742 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd574a-29a8-49fb-bf04-dc0ce685074b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.134991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 99/193] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:07.136528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95033-e915-48c9-9bde-11620fd8a430 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.136818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95033-e915-48c9-9bde-11620fd8a430 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.137087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95033-e915-48c9-9bde-11620fd8a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.152844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-86a95033-e915-48c9-9bde-11620fd8a430 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:07.154028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-86a95033-e915-48c9-9bde-11620fd8a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:07.216428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62aa8-1912-49e8-b873-d23a0c53a7ce None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.217055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 100/194] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:07.221568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a95033-e915-48c9-9bde-11620fd8a430 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.251145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.251826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.252102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.252368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.253106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.254589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.275372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 95/195] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:07 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:07.276181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.321155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a95033-e915-48c9-9bde-11620fd8a430 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.356271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.357128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.357412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.357694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.384662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dc918-c332-4f81-8062-a690d5154608 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.428002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.428002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.428002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.428002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] PATH_INFO: `/v3/users/5028192a75ba45f892a8c64447aa1aa9` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.429390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] RBAC: Authorizing `identity:get_user(user_id=5028192a75ba45f892a8c64447aa1aa9)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.430887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.431506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.432717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 96/196] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/users/5028192a75ba45f892a8c64447aa1aa9 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:07.433101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.433464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.544053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 101/197] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:07.546202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.548360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8815a1-8a63-4e76-9fcf-fffa15810be9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.592761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.593686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.593969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.594244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.612565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:07.620570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:07.621678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 97/198] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:07.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.662475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6e68e-a174-4ef9-a659-4121478797b4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.697019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.697780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.698185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.698570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.732396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557283f-5448-422f-b959-29ac3c65e842 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.765963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.767096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.767237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.767644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.768060 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.768986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.769650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.771243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.773173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 98/199] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:07.774100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.870507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 102/200] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:07.873367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe982f-238e-42e0-a0e0-d91bb42a34ea None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:07.875666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.908148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:07.909137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:07.909556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:07.909967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:07.910902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:07.911349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:07.913059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:07.922107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 99/201] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:07.923190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:07.979435 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec1681-5b19-498f-8dba-3f31400f0d7c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:08.014029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:08.014694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:08.015103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:08.015420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:08.016277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=34be00073f59496f8646081eb09fc413) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:08.016640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:08.018303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:08.024002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 103/202] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/role_assignments?user.id=34be00073f59496f8646081eb09fc413&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:08.024929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:08.032602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81610-f24f-422d-ac67-3043225b418b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:08.068710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:08.069781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:08.070157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:08.070531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:08.071948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:08.073579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:08.075435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 100/203] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:07 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:08.090876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:08.134295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48fad6-84f1-4f79-b577-8cddc1a92ccf None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:08.175415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:08.176343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:08.176620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:08.176928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] PATH_INFO: `/v3/users/34be00073f59496f8646081eb09fc413` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:08.181320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] RBAC: Authorizing `identity:get_user(user_id=34be00073f59496f8646081eb09fc413)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:08.183561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:08.188817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 104/204] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:08 2022] GET /identity/v3/users/34be00073f59496f8646081eb09fc413 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:08.195312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:08.273128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572340-e517-4f7e-bac7-ca362c1d53c5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:08.307172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d6d0-c93e-4d90-b620-065ed07e38b5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:08.314670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:08.315366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:08.315655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:08.315933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:08.316859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] RBAC: Adding query filter params (role.id=e0d63a4c4aae4c998504ffee4b2664be, scope.project.id=53a50937bcf747f58de9c47b2be53f10, user.id=5028192a75ba45f892a8c64447aa1aa9) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:08.317462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:08.319031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:08.326366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 101/205] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:08 2022] GET /identity/v3/role_assignments?user.id=5028192a75ba45f892a8c64447aa1aa9&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=e0d63a4c4aae4c998504ffee4b2664be => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:08.381591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:08.382290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:08.382572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:08.382846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:08.525951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:08.527454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:08.694849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 105/206] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:08.701894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:08.855997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3006e-4f4e-46af-b9bd-97bef454fd50 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:08.912777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715591f8-f169-487b-bb44-806416b16358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:08.914940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715591f8-f169-487b-bb44-806416b16358 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:08.914940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715591f8-f169-487b-bb44-806416b16358 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:08.914940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715591f8-f169-487b-bb44-806416b16358 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:08.917319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715591f8-f169-487b-bb44-806416b16358 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:08.918777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715591f8-f169-487b-bb44-806416b16358 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:08.924006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 102/207] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:08 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:08.929819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:09.050576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b47fc-4953-4ff2-a5b4-4a4f5a0002df None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:09.093381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57533c06-8302-43bb-a5f7-37896764b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:09.094053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57533c06-8302-43bb-a5f7-37896764b3bb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:09.094336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57533c06-8302-43bb-a5f7-37896764b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:09.094615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57533c06-8302-43bb-a5f7-37896764b3bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:09.095460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57533c06-8302-43bb-a5f7-37896764b3bb None admin] RBAC: Adding query filter params (role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=34be00073f59496f8646081eb09fc413) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:09.095774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57533c06-8302-43bb-a5f7-37896764b3bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:09.097286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57533c06-8302-43bb-a5f7-37896764b3bb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:09.102988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 106/208] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:08 2022] GET /identity/v3/role_assignments?user.id=34be00073f59496f8646081eb09fc413&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:09.750277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab49f1c-9f26-469f-ab37-8745ecefd01a None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:09.750711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab49f1c-9f26-469f-ab37-8745ecefd01a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:09.751102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab49f1c-9f26-469f-ab37-8745ecefd01a None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:09.752642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 103/209] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:09.758033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f9dc-3a72-45b7-af1f-d93136b91c9e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:09.758441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f9dc-3a72-45b7-af1f-d93136b91c9e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:09.758818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f9dc-3a72-45b7-af1f-d93136b91c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:09.776170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-65f6f9dc-3a72-45b7-af1f-d93136b91c9e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:09.777388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-65f6f9dc-3a72-45b7-af1f-d93136b91c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:09.849851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 107/210] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:09.877652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab49f1c-9f26-469f-ab37-8745ecefd01a None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:09.979913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab49f1c-9f26-469f-ab37-8745ecefd01a None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.012939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c632a-0666-47fa-bf2f-b1f494482e9e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.013956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c632a-0666-47fa-bf2f-b1f494482e9e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.014444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c632a-0666-47fa-bf2f-b1f494482e9e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.015184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.016052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.016334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.016608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.017260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 108/211] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:10.025733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930cc6c-9802-4340-a802-045702375a41 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.026256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930cc6c-9802-4340-a802-045702375a41 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.026768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930cc6c-9802-4340-a802-045702375a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.030784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:10.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:10.039259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:10.040079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 104/212] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:10.046459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.053472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a930cc6c-9802-4340-a802-045702375a41 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:10.054944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a930cc6c-9802-4340-a802-045702375a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:10.130995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 109/213] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:10.149944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6bd9-20c5-4d3e-a476-d411af8ed202 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.156209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930cc6c-9802-4340-a802-045702375a41 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.191175 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.192241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.192757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.193230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.194618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:10.195140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:10.197105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:10.208596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 105/214] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:10.214891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.280198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930cc6c-9802-4340-a802-045702375a41 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.318488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.319322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.319749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.319851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.321072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:10.322546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:10.328770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 110/215] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:10.328916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3de473-7b71-4e9e-9358-6c7dc8dd16d3 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.330395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.363474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.364529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.364925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.365397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] PATH_INFO: `/v3/users/c262e9f46c544f90b924b23d5a6a14ff` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.378676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] RBAC: Authorizing `identity:get_user(user_id=c262e9f46c544f90b924b23d5a6a14ff)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:10.380413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:10.387158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 106/216] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/users/c262e9f46c544f90b924b23d5a6a14ff => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:10.388344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.437041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356fb1a-4e48-4aaa-a036-8a47c7b11e2f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.473179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4ae3b-be80-47eb-8762-2a442eb62b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.474175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ae3b-be80-47eb-8762-2a442eb62b39 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.474601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ae3b-be80-47eb-8762-2a442eb62b39 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.475059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ae3b-be80-47eb-8762-2a442eb62b39 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.475921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ae3b-be80-47eb-8762-2a442eb62b39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:10.477535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ae3b-be80-47eb-8762-2a442eb62b39 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:10.491776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24c2f8-180c-40f1-9a9e-433d455cdb65 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.509658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 111/217] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:10 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:44:10.541535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.542140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.542418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.542689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.600442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240740c-de21-40e4-a66c-59b38fb16bd2 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.600794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240740c-de21-40e4-a66c-59b38fb16bd2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.601039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240740c-de21-40e4-a66c-59b38fb16bd2 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.602731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 112/218] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:10.608340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344738-287d-4c0e-8d17-363a6e13ea3d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.608709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344738-287d-4c0e-8d17-363a6e13ea3d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.608995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344738-287d-4c0e-8d17-363a6e13ea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.618490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:10.620012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:10.628168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0f344738-287d-4c0e-8d17-363a6e13ea3d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:10.630084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0f344738-287d-4c0e-8d17-363a6e13ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:10.715236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 113/219] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:10.732564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 107/220] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:44:10.737941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f344738-287d-4c0e-8d17-363a6e13ea3d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.738892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.840104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60350084-cd58-4af1-b2ac-d5fe6190d7d5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.864688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f344738-287d-4c0e-8d17-363a6e13ea3d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:10.874383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.875270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.875547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.875820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.877070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:10.878537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:10.880569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 108/221] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:10.886647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.909890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:10.910717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:10.910993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:10.911265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:10.922131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:10.930736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:10.931662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:10.932473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 114/222] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:10.937954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:10.997660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996409a-2f8c-4cd5-90c5-96e993e86e99 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:11.039736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:11.040872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.041292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.041691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.043039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=c262e9f46c544f90b924b23d5a6a14ff) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:11.043764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:11.045852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:11.048540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d0e7-524a-4cc0-bd67-d3cb3b60c2dc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:11.053535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 109/223] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/role_assignments?user.id=c262e9f46c544f90b924b23d5a6a14ff&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=e7ad4f242602439f80a3999084d931dd => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:11.088922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:11.089627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.089909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.090240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.091043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:11.091354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:11.092937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:11.104919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 115/224] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:11.110964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:11.266411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b8352-2c40-482c-9b43-083c3691ede2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:11.311880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36234448-ec60-4efc-ac30-c65f0265ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:11.312798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234448-ec60-4efc-ac30-c65f0265ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.313320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234448-ec60-4efc-ac30-c65f0265ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.313799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234448-ec60-4efc-ac30-c65f0265ebe6 None admin] PATH_INFO: `/v3/users/34be00073f59496f8646081eb09fc413` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.317547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36234448-ec60-4efc-ac30-c65f0265ebe6 None admin] RBAC: Authorizing `identity:get_user(user_id=34be00073f59496f8646081eb09fc413)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:11.319054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36234448-ec60-4efc-ac30-c65f0265ebe6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:11.321128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 110/225] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:11 2022] GET /identity/v3/users/34be00073f59496f8646081eb09fc413 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:11.326718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:11.352788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865c6a0-4de9-45e4-a8c6-e10bbeee1fec None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.353071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865c6a0-4de9-45e4-a8c6-e10bbeee1fec None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.353306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865c6a0-4de9-45e4-a8c6-e10bbeee1fec None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.355074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 111/226] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:11.360598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ad1d-dd57-4046-a144-ddc7648cd821 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.360955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ad1d-dd57-4046-a144-ddc7648cd821 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.361241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ad1d-dd57-4046-a144-ddc7648cd821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.385311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-de80ad1d-dd57-4046-a144-ddc7648cd821 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:11.386885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-de80ad1d-dd57-4046-a144-ddc7648cd821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:11.446672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8ac5-d639-476b-93f3-1c69600ed581 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:11.484060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:11.484964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.485251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.485525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.489992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:11.491450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:11.493440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 116/227] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:11 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:11.499104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:11.529024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 112/228] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:11.549643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ad1d-dd57-4046-a144-ddc7648cd821 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:11.656241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ad1d-dd57-4046-a144-ddc7648cd821 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:11.691896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:11.693151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.693619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.694321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.705704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:11.715032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:11.715901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:11.716716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:11.719568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 113/229] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:11.726431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b5921-c063-4afc-83ed-751fb67ab283 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:11.727511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:11.790712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:11.792011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.792481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.792968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/34be00073f59496f8646081eb09fc413/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.795145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] RBAC: Authorizing `identity:create_grant(project_id=1be83ad5dbb644e3b505529ecd3d8b9a, user_id=34be00073f59496f8646081eb09fc413, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:11.796922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:11.821003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:11 2022] PUT /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/34be00073f59496f8646081eb09fc413/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:11.869946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04acf93-3f71-4777-942d-c05af9e27844 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:11.904608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:11.905825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:11.906349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:11.906812 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:11.907758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:11.908250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:11.909859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:11.918822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 114/231] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:11.931661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:12.064866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056084e-575f-49aa-b8a2-0dda3ba7074d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:12.105944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:12.106856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:12.107131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:12.107400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] PATH_INFO: `/v3/users/34be00073f59496f8646081eb09fc413` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:12.108738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] RBAC: Authorizing `identity:get_user(user_id=34be00073f59496f8646081eb09fc413)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:12.110265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:12.112268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 118/232] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:11 2022] GET /identity/v3/users/34be00073f59496f8646081eb09fc413 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:12.117799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:12.238717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a8714-1adf-4150-a8e6-41c29b30b452 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:12.276126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6409a-ac5e-4806-8da1-d3afe27fff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:12.277270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6409a-ac5e-4806-8da1-d3afe27fff7f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:12.277713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6409a-ac5e-4806-8da1-d3afe27fff7f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:12.278120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6409a-ac5e-4806-8da1-d3afe27fff7f None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:12.279428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6409a-ac5e-4806-8da1-d3afe27fff7f None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:12.281064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6409a-ac5e-4806-8da1-d3afe27fff7f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:12.282926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 115/233] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:12 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:12.288841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:12.424694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8b02-1ba4-4185-81ca-44929959a12b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:12.464145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfff998-77c9-47d3-bd45-99f3e13e89d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:12.465092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff998-77c9-47d3-bd45-99f3e13e89d0 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:12.465374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff998-77c9-47d3-bd45-99f3e13e89d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:12.465647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff998-77c9-47d3-bd45-99f3e13e89d0 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/34be00073f59496f8646081eb09fc413/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:12.473429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfff998-77c9-47d3-bd45-99f3e13e89d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be83ad5dbb644e3b505529ecd3d8b9a, user_id=34be00073f59496f8646081eb09fc413, role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:12.474887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfff998-77c9-47d3-bd45-99f3e13e89d0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:12.503454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:12 2022] PUT /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/34be00073f59496f8646081eb09fc413/roles/08dee391f7e34431ad610ccbb9b49349 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:13.461869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d762-68e0-4302-b629-423e3e2964d4 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:13.462708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d762-68e0-4302-b629-423e3e2964d4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:13.463173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d762-68e0-4302-b629-423e3e2964d4 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:13.464788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 116/235] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:13.482253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723aed-0975-4f08-ab94-211202115791 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:13.483179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723aed-0975-4f08-ab94-211202115791 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:13.483670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723aed-0975-4f08-ab94-211202115791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:13.504332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2a723aed-0975-4f08-ab94-211202115791 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:13.505829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2a723aed-0975-4f08-ab94-211202115791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:13.551646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f1416-fe0c-4b8f-abe1-ff005ba6c31f None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:13.552425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f1416-fe0c-4b8f-abe1-ff005ba6c31f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:13.553243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f1416-fe0c-4b8f-abe1-ff005ba6c31f None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:13.555127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 117/236] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:13.561752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba155-8c19-43a3-a9fa-abd7e526c70e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:13.562437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba155-8c19-43a3-a9fa-abd7e526c70e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:13.562929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba155-8c19-43a3-a9fa-abd7e526c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:13.582019 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b45ba155-8c19-43a3-a9fa-abd7e526c70e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:13.583983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b45ba155-8c19-43a3-a9fa-abd7e526c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:13.626992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 120/237] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:13.649242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723aed-0975-4f08-ab94-211202115791 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:13.664807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 118/238] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:13.766223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ba155-8c19-43a3-a9fa-abd7e526c70e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:13.782081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723aed-0975-4f08-ab94-211202115791 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:13.854663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:13.855850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:13.856323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:13.856811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:13.878619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:13.887231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:13.888093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:13.888928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:13.891597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 121/239] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:13.897646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:13.957580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ba155-8c19-43a3-a9fa-abd7e526c70e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.000296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d304a-2953-4762-9d7a-a042024f4b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.001284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d304a-2953-4762-9d7a-a042024f4b10 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.001722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d304a-2953-4762-9d7a-a042024f4b10 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.002437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d304a-2953-4762-9d7a-a042024f4b10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.004162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d304a-2953-4762-9d7a-a042024f4b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:14.006380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d304a-2953-4762-9d7a-a042024f4b10 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:14.008330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 119/240] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:14.010286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047168d-cb9c-47ff-9f87-571be3c62727 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.011092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047168d-cb9c-47ff-9f87-571be3c62727 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.011771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047168d-cb9c-47ff-9f87-571be3c62727 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.017478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 120/241] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:14.017763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047168d-cb9c-47ff-9f87-571be3c62727 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:14.046587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5c31-fdbb-4892-8dad-f9d87968f7f4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.090483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a904219-2aec-4820-a3bb-4cbb8bb525f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.091700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904219-2aec-4820-a3bb-4cbb8bb525f1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.092151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904219-2aec-4820-a3bb-4cbb8bb525f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.092798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904219-2aec-4820-a3bb-4cbb8bb525f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.094574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a904219-2aec-4820-a3bb-4cbb8bb525f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:14.095039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a904219-2aec-4820-a3bb-4cbb8bb525f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:14.096601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a904219-2aec-4820-a3bb-4cbb8bb525f1 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:14.107883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 122/242] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:14.109802 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468cb6b-37c0-43f1-8296-6b5361ef060b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.110259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468cb6b-37c0-43f1-8296-6b5361ef060b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.110677 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468cb6b-37c0-43f1-8296-6b5361ef060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.125826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047168d-cb9c-47ff-9f87-571be3c62727 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.133674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2468cb6b-37c0-43f1-8296-6b5361ef060b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:14.135467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2468cb6b-37c0-43f1-8296-6b5361ef060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:14.165071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.166268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.166681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.167209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.168523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:14.170673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:14.196146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 121/243] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:14 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:14.197250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:14.234061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 123/244] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:14.268090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468cb6b-37c0-43f1-8296-6b5361ef060b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:14.410863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124e40-e049-4c9b-9052-7c1df6b37c7c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.434421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468cb6b-37c0-43f1-8296-6b5361ef060b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.454262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.455406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.455857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.456288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] PATH_INFO: `/v3/users/71866a4fa6614938a83db9e028ee2853` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.471965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] RBAC: Authorizing `identity:get_user(user_id=71866a4fa6614938a83db9e028ee2853)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:14.474178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:14.476078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 122/245] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:14 2022] GET /identity/v3/users/71866a4fa6614938a83db9e028ee2853 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:14.479497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b3a38-5cb8-4278-95f2-f89048ce913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.480481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3a38-5cb8-4278-95f2-f89048ce913b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.481533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:14.482621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3a38-5cb8-4278-95f2-f89048ce913b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.484770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3a38-5cb8-4278-95f2-f89048ce913b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.497126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b3a38-5cb8-4278-95f2-f89048ce913b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-3b0b3a38-5cb8-4278-95f2-f89048ce913b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:14.505062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:14.505980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:14.506783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 124/246] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:14.507950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3106-d2ee-4e64-a160-f34380a40b9c None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.508119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3106-d2ee-4e64-a160-f34380a40b9c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.509479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3106-d2ee-4e64-a160-f34380a40b9c None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.509665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 125/247] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:14.516969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a3106-d2ee-4e64-a160-f34380a40b9c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:14.587041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af49881-bbc3-4b3d-a97c-fcf6f1162490 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.620255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.620945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.621230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.621505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.628067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a3106-d2ee-4e64-a160-f34380a40b9c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.675676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911266cd-4f3a-4a38-bdff-6680e32f2dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.676422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911266cd-4f3a-4a38-bdff-6680e32f2dfa None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.676759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911266cd-4f3a-4a38-bdff-6680e32f2dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.677163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911266cd-4f3a-4a38-bdff-6680e32f2dfa None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.678238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911266cd-4f3a-4a38-bdff-6680e32f2dfa None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:14.678563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911266cd-4f3a-4a38-bdff-6680e32f2dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:14.679993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911266cd-4f3a-4a38-bdff-6680e32f2dfa None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:14.692303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 126/248] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:14.693804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9510-c50c-466f-bd8a-51ba9b4ac952 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.694096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9510-c50c-466f-bd8a-51ba9b4ac952 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.694375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9510-c50c-466f-bd8a-51ba9b4ac952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.698605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:14.700333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:14.714463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8b6a9510-c50c-466f-bd8a-51ba9b4ac952 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:14.716054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8b6a9510-c50c-466f-bd8a-51ba9b4ac952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:14.801431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 127/249] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:14.805506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a9510-c50c-466f-bd8a-51ba9b4ac952 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:14.814224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 123/250] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:14.819660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:14.928335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a9510-c50c-466f-bd8a-51ba9b4ac952 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.956246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af504c2-0e94-47f9-b768-6bb7296d66a4 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:14.964774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:14.966071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:14.966553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:14.967067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] PATH_INFO: `/v3/users/c262e9f46c544f90b924b23d5a6a14ff` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:14.968590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] RBAC: Authorizing `identity:get_user(user_id=c262e9f46c544f90b924b23d5a6a14ff)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:14.970272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:14.972146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 128/251] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:14 2022] GET /identity/v3/users/c262e9f46c544f90b924b23d5a6a14ff => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:14.973185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.002211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.003280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.003577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.003842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.009420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:15.011283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:15.013437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 124/252] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:14 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:15.014294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.092374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e637b3-d776-4806-a36c-0dd5b8a10405 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:15.132742 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.133620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.134192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.134476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.152035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:15.161320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:15.162204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:15.162975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 129/253] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:15.163611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.216302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94cf2-e908-4f78-b574-8597266a5c47 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:15.276161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.277081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.277360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.277635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.279285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:15.281206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:15.283992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 125/254] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:15 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:15.289283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.316947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e49b-97b9-45e3-9102-2e0027d1bba9 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:15.354012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767c612-3957-48b4-8758-46182e004119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.354845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767c612-3957-48b4-8758-46182e004119 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.355440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767c612-3957-48b4-8758-46182e004119 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.355728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767c612-3957-48b4-8758-46182e004119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.356900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767c612-3957-48b4-8758-46182e004119 None admin] RBAC: Adding query filter params (role.id=e0d63a4c4aae4c998504ffee4b2664be, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=71866a4fa6614938a83db9e028ee2853) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:15.357220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767c612-3957-48b4-8758-46182e004119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:15.358927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767c612-3957-48b4-8758-46182e004119 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:15.366772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 130/255] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:15 2022] GET /identity/v3/role_assignments?user.id=71866a4fa6614938a83db9e028ee2853&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=e0d63a4c4aae4c998504ffee4b2664be => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:15.368626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33df2f0-aec3-41c9-81ef-e55910e574c8 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.368995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33df2f0-aec3-41c9-81ef-e55910e574c8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.369283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33df2f0-aec3-41c9-81ef-e55910e574c8 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.371643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 131/256] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:15.372449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33df2f0-aec3-41c9-81ef-e55910e574c8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.398820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d84a-f513-43ee-b57d-8743f2dfb2bf None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:15.444236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28f783-73ed-4530-93e3-53240ff0519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.444980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f783-73ed-4530-93e3-53240ff0519c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.445256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f783-73ed-4530-93e3-53240ff0519c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.448234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f783-73ed-4530-93e3-53240ff0519c None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.451527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28f783-73ed-4530-93e3-53240ff0519c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:15.451527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28f783-73ed-4530-93e3-53240ff0519c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:15.451527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28f783-73ed-4530-93e3-53240ff0519c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:15.471244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 126/257] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:15.472836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283099-4a73-43d5-adf8-20b9f3ed37aa None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.473696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283099-4a73-43d5-adf8-20b9f3ed37aa None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.474134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283099-4a73-43d5-adf8-20b9f3ed37aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.510159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-59283099-4a73-43d5-adf8-20b9f3ed37aa None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:15.516855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-59283099-4a73-43d5-adf8-20b9f3ed37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:15.537261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33df2f0-aec3-41c9-81ef-e55910e574c8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:15.612547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.613705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.613983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.614256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/c262e9f46c544f90b924b23d5a6a14ff/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.617818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be83ad5dbb644e3b505529ecd3d8b9a, user_id=c262e9f46c544f90b924b23d5a6a14ff, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:15.619690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:15.628629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 127/258] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:15.629678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59283099-4a73-43d5-adf8-20b9f3ed37aa None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.647848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 132/259] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:15 2022] PUT /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/c262e9f46c544f90b924b23d5a6a14ff/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:15.664962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.810766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59283099-4a73-43d5-adf8-20b9f3ed37aa None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:15.839443 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ab2d8-cb57-4a61-9156-414746e09313 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:15.846090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.846996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.847274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.847545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] PATH_INFO: `/v3/users/34be00073f59496f8646081eb09fc413` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.848822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] RBAC: Authorizing `identity:get_user(user_id=34be00073f59496f8646081eb09fc413)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:15.850308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:15.852162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 128/260] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:15 2022] GET /identity/v3/users/34be00073f59496f8646081eb09fc413 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:15.858878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:15.909393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:15.910229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:15.910509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:15.910788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:15.934534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:15.948296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:15.949304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:15.950094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 133/261] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:15.957355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:16.042272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718c341-6ff5-41a2-a5b8-e3b1788335d0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:16.113539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:16.114214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:16.114494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:16.114773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:16.126668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f1c5e-db7a-4542-8048-1a532145f41e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:16.174099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:16.174814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:16.175093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:16.175368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:16.176141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:16.176451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:16.177968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:16.195206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 134/262] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:16.214488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:16.215969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:16.230150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:16.323492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 129/263] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:44:16.329548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:16.440790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa94bd-8b9e-4a8d-a853-50d047fc3784 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:16.458673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7148b-35db-430a-a0ba-e008f725f863 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:16.467121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:16.468090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:16.468366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:16.468634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:16.470566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:16.472067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:16.473840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 130/264] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:16 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:16.480448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:16.517446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:16.518359 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:16.518643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:16.518922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] PATH_INFO: `/v3/users/34be00073f59496f8646081eb09fc413` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:16.520190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] RBAC: Authorizing `identity:get_user(user_id=34be00073f59496f8646081eb09fc413)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:16.521704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:16.523392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 135/265] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:16 2022] GET /identity/v3/users/34be00073f59496f8646081eb09fc413 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:16.542587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:16.592426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e05366-ea75-4944-ac4c-bc8128c874b0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:16.626092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:16.626777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:16.627057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:16.627332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:16.628174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=34be00073f59496f8646081eb09fc413) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:16.628488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:16.629977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:16.636851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 131/266] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:16 2022] GET /identity/v3/role_assignments?user.id=34be00073f59496f8646081eb09fc413&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:16.679143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1712777-9b73-406d-903a-c36d7fb0a420 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:16.718613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:16.719223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:16.719500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:16.719778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:16.791077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:16.792593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:16.895009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 136/267] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:44:16.900715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:17.063458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923165-8cba-4c01-9ae0-91cd8eecba04 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:17.110298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3290b-8880-49c7-b1ab-de67a64f5f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:17.111617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3290b-8880-49c7-b1ab-de67a64f5f15 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.112094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3290b-8880-49c7-b1ab-de67a64f5f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.112560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3290b-8880-49c7-b1ab-de67a64f5f15 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.117660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3290b-8880-49c7-b1ab-de67a64f5f15 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:17.119507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3290b-8880-49c7-b1ab-de67a64f5f15 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:17.121651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 132/268] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:16 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:17.128063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:17.236038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a6287-a446-4fe4-b4a6-f6ab99e05b96 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:17.270460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2505f-a8d3-4cd8-9d90-fc7100fffc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:17.271134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2505f-a8d3-4cd8-9d90-fc7100fffc76 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.271416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2505f-a8d3-4cd8-9d90-fc7100fffc76 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.271692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2505f-a8d3-4cd8-9d90-fc7100fffc76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.272539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2505f-a8d3-4cd8-9d90-fc7100fffc76 None admin] RBAC: Adding query filter params (role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=34be00073f59496f8646081eb09fc413) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:17.272890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2505f-a8d3-4cd8-9d90-fc7100fffc76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:17.274344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2505f-a8d3-4cd8-9d90-fc7100fffc76 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:17.280831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 137/269] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:17 2022] GET /identity/v3/role_assignments?user.id=34be00073f59496f8646081eb09fc413&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:17.462882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937bd3c-6749-4f6f-9aff-7ee95b427c92 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.463528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937bd3c-6749-4f6f-9aff-7ee95b427c92 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.464100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937bd3c-6749-4f6f-9aff-7ee95b427c92 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.466158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 133/270] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:17.471768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230d0aa-ea97-4767-aac1-5bf1a0d0a390 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.472067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230d0aa-ea97-4767-aac1-5bf1a0d0a390 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.472349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230d0aa-ea97-4767-aac1-5bf1a0d0a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.492640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-d230d0aa-ea97-4767-aac1-5bf1a0d0a390 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:17.493942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d230d0aa-ea97-4767-aac1-5bf1a0d0a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:17.577584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 138/271] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:17.606094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937bd3c-6749-4f6f-9aff-7ee95b427c92 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:17.714745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937bd3c-6749-4f6f-9aff-7ee95b427c92 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:17.752475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e982efd-82da-4c9b-b7cb-592ad01d04e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:17.753327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e982efd-82da-4c9b-b7cb-592ad01d04e2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.753613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e982efd-82da-4c9b-b7cb-592ad01d04e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.753944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e982efd-82da-4c9b-b7cb-592ad01d04e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.765018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e982efd-82da-4c9b-b7cb-592ad01d04e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4e982efd-82da-4c9b-b7cb-592ad01d04e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:17.772954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:17.774086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:17.775327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 134/272] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:17.780231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230d0aa-ea97-4767-aac1-5bf1a0d0a390 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:17.817247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f0547-9f11-4d8d-8af5-5190e453c0ad None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.817575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f0547-9f11-4d8d-8af5-5190e453c0ad None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.817804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f0547-9f11-4d8d-8af5-5190e453c0ad None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.819514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 135/273] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:17.825503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6b7b-5f92-4b5b-8aa7-ec846159914c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.825790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6b7b-5f92-4b5b-8aa7-ec846159914c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.826072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6b7b-5f92-4b5b-8aa7-ec846159914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.843117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-13cf6b7b-5f92-4b5b-8aa7-ec846159914c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:17.844313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-13cf6b7b-5f92-4b5b-8aa7-ec846159914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:17.899833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230d0aa-ea97-4767-aac1-5bf1a0d0a390 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:17.928786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 136/274] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:17.938016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:17.938701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:17.938986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:17.939268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:17.940028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:17.940338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:17.941768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:17.948550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf6b7b-5f92-4b5b-8aa7-ec846159914c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:17.950542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 139/275] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:17.955900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:18.050165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf6b7b-5f92-4b5b-8aa7-ec846159914c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:18.059171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ae8ec-3103-4c4d-a128-178b9db650b3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:18.084358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:18.085204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.085485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.085816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.087026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:18.088486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:18.094847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 137/276] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:18.096225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:18.099279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:18.100186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.100472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.100779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] PATH_INFO: `/v3/users/47a7d5cfbd584770944f7524cdca0370` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.116030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] RBAC: Authorizing `identity:get_user(user_id=47a7d5cfbd584770944f7524cdca0370)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:18.117684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:18.119451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 140/277] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:17 2022] GET /identity/v3/users/47a7d5cfbd584770944f7524cdca0370 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:18.125098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:18.199622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138091-33ff-4faf-8331-f6fbccb57f06 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:18.226612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4ea0-da2c-4628-830c-877317f5a251 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:18.237441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c058-4e2e-45bd-b81d-49d7b6ee2c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:18.238495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c058-4e2e-45bd-b81d-49d7b6ee2c1c None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.238969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c058-4e2e-45bd-b81d-49d7b6ee2c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.239434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c058-4e2e-45bd-b81d-49d7b6ee2c1c None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.240357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c058-4e2e-45bd-b81d-49d7b6ee2c1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:18.242072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c058-4e2e-45bd-b81d-49d7b6ee2c1c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:18.264537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa391f-b400-46c6-bdcd-13f537262c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:18.265394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa391f-b400-46c6-bdcd-13f537262c90 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.265685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa391f-b400-46c6-bdcd-13f537262c90 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.266021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa391f-b400-46c6-bdcd-13f537262c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.266768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 138/278] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:18 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:18.272722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa391f-b400-46c6-bdcd-13f537262c90 None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, user.id=47a7d5cfbd584770944f7524cdca0370, scope.system=all) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:18.272722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa391f-b400-46c6-bdcd-13f537262c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:18.272722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa391f-b400-46c6-bdcd-13f537262c90 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:18.287220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 141/279] 10.222.0.52 () {56 vars in 1308 bytes} [Tue May 10 18:44:18 2022] GET /identity/v3/role_assignments?user.id=47a7d5cfbd584770944f7524cdca0370&scope.system=all&role.id=e7ad4f242602439f80a3999084d931dd => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:18.397903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac039a4-115d-45a8-9482-5c1cee459384 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.398562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac039a4-115d-45a8-9482-5c1cee459384 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.399040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac039a4-115d-45a8-9482-5c1cee459384 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.400979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 139/280] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:18.407296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7237f1-a5f9-4995-adca-57dadf48520a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.407616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7237f1-a5f9-4995-adca-57dadf48520a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.407866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7237f1-a5f9-4995-adca-57dadf48520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.426406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-de7237f1-a5f9-4995-adca-57dadf48520a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:18.427674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-de7237f1-a5f9-4995-adca-57dadf48520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:18.507848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 142/281] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:18.532980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac039a4-115d-45a8-9482-5c1cee459384 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:18.647762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac039a4-115d-45a8-9482-5c1cee459384 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:18.684906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:18.685654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.685934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.686219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.700279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:18.703398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078f80-f799-4b48-af09-56fcd6df648d None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.703834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078f80-f799-4b48-af09-56fcd6df648d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.703990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078f80-f799-4b48-af09-56fcd6df648d None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.705615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 143/282] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:18.708811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:18.709666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:18.710488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 140/283] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:18.711648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3c520-fd71-42ba-ac39-4f8ca5a1bdc4 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.711648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3c520-fd71-42ba-ac39-4f8ca5a1bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.711880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3c520-fd71-42ba-ac39-4f8ca5a1bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.716551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:18.732923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-cbc3c520-fd71-42ba-ac39-4f8ca5a1bdc4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:18.734468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cbc3c520-fd71-42ba-ac39-4f8ca5a1bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:18.843538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 144/284] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:18.851732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000371d-ebfb-4876-a5b4-cd4827fa8bee None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:18.883335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3c520-fd71-42ba-ac39-4f8ca5a1bdc4 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:18.886957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:18.887649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:18.887938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:18.888215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:18.889012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:18.889327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:18.890765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:18.904142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 141/285] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:18.905546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:19.014111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4a5b9-e313-496b-b93e-80ae1a61f262 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:19.050860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:19.051762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:19.052047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:19.052336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] PATH_INFO: `/v3/users/71866a4fa6614938a83db9e028ee2853` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:19.054428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] RBAC: Authorizing `identity:get_user(user_id=71866a4fa6614938a83db9e028ee2853)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:19.055909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:19.062766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 142/286] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:18 2022] GET /identity/v3/users/71866a4fa6614938a83db9e028ee2853 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:19.064015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:19.097332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3c520-fd71-42ba-ac39-4f8ca5a1bdc4 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:19.130446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:19.131250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:19.131545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:19.131803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:19.143745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:19.153709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:19.154642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:19.155496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 145/287] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:19.161396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:19.193300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07be56-024a-48e7-ac00-9d7f5e33a6fa None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:19.250660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:19.254432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:19.254887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:19.255354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:19.257671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:19.259309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:19.262814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 143/288] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:19 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:19.270577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:19.339215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595aa663-167a-4bdc-bf4e-bbdf91b43b8e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:19.394807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:19.396637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:19.397108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:19.398232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:19.399172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:19.399804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:19.402700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:19.416876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 146/289] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:19.423446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:19.454677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd707c-b1c3-4a51-8474-bdc29174ef89 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:19.542239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210713b-7755-4bc8-b4f1-7124e83d1d03 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:19.549396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:19.550314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:19.550594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:19.550868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/71866a4fa6614938a83db9e028ee2853/roles/e0d63a4c4aae4c998504ffee4b2664be` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:19.553522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be83ad5dbb644e3b505529ecd3d8b9a, user_id=71866a4fa6614938a83db9e028ee2853, role_id=e0d63a4c4aae4c998504ffee4b2664be)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:19.555068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:19.587658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:19.588558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:19.588909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:19.589183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] PATH_INFO: `/v3/users/c262e9f46c544f90b924b23d5a6a14ff` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:19.590451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] RBAC: Authorizing `identity:get_user(user_id=c262e9f46c544f90b924b23d5a6a14ff)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:19.590910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 144/290] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:19 2022] PUT /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/users/71866a4fa6614938a83db9e028ee2853/roles/e0d63a4c4aae4c998504ffee4b2664be => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:44:19.591955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:19.594024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 147/291] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:19 2022] GET /identity/v3/users/c262e9f46c544f90b924b23d5a6a14ff => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:19.599967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:19.705357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd234-f10d-44f7-a848-44358cbc2375 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:19.739863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:19.740593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:19.740918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:19.741194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:19.811791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:19.813257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:19.916184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 145/292] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:44:19.921740 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:20.033743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2abd9-2fed-460e-800a-6860786b90e0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:20.066570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e82b-9438-4c40-b827-969a35224fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:20.067367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e82b-9438-4c40-b827-969a35224fab None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:20.067695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e82b-9438-4c40-b827-969a35224fab None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:20.067970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e82b-9438-4c40-b827-969a35224fab None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:20.069266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e82b-9438-4c40-b827-969a35224fab None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:20.070758 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e82b-9438-4c40-b827-969a35224fab None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:20.072487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 148/293] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:19 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:20.078493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:20.199287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ebc7b-114d-472a-b95f-f5389e568dc7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:20.243187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a0c4-6a2d-42a7-989f-2f38d286276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:20.243866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a0c4-6a2d-42a7-989f-2f38d286276b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:20.244149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a0c4-6a2d-42a7-989f-2f38d286276b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:20.244424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a0c4-6a2d-42a7-989f-2f38d286276b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:20.245288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178a0c4-6a2d-42a7-989f-2f38d286276b None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=c262e9f46c544f90b924b23d5a6a14ff) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:20.245607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178a0c4-6a2d-42a7-989f-2f38d286276b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:20.247035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178a0c4-6a2d-42a7-989f-2f38d286276b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:20.253035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 146/294] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:20 2022] GET /identity/v3/role_assignments?user.id=c262e9f46c544f90b924b23d5a6a14ff&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=e7ad4f242602439f80a3999084d931dd => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:20.739779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5c195-9f59-4cb0-b477-4eaf715e2d68 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:20.741672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5c195-9f59-4cb0-b477-4eaf715e2d68 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:20.741672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5c195-9f59-4cb0-b477-4eaf715e2d68 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:20.742230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 149/295] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:20.748152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af9a3-5fdb-4f22-b93d-8121bf7b1e77 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:20.749109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af9a3-5fdb-4f22-b93d-8121bf7b1e77 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:20.749583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af9a3-5fdb-4f22-b93d-8121bf7b1e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:20.767046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-677af9a3-5fdb-4f22-b93d-8121bf7b1e77 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:20.768564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-677af9a3-5fdb-4f22-b93d-8121bf7b1e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:20.842557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 147/296] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:20.866555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5c195-9f59-4cb0-b477-4eaf715e2d68 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:20.974120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5c195-9f59-4cb0-b477-4eaf715e2d68 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.008816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd9660-be5d-41f2-a66e-3feb5c34927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.009979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd9660-be5d-41f2-a66e-3feb5c34927d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.010459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd9660-be5d-41f2-a66e-3feb5c34927d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.011373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd9660-be5d-41f2-a66e-3feb5c34927d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.021896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd9660-be5d-41f2-a66e-3feb5c34927d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-4fdd9660-be5d-41f2-a66e-3feb5c34927d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:21.030171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:21.031046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:21.031839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:21.039010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 150/297] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:21.040906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677af9a3-5fdb-4f22-b93d-8121bf7b1e77 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:21.049295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116164cb-820d-4710-b713-57d806dd3bec None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.049607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116164cb-820d-4710-b713-57d806dd3bec None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.049878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116164cb-820d-4710-b713-57d806dd3bec None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.051421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 151/298] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:21.057918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0b256-54c6-45b6-992e-5929b392d059 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.058192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0b256-54c6-45b6-992e-5929b392d059 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.058467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0b256-54c6-45b6-992e-5929b392d059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.079410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-51d0b256-54c6-45b6-992e-5929b392d059 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:21.081120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-51d0b256-54c6-45b6-992e-5929b392d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:21.148459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677af9a3-5fdb-4f22-b93d-8121bf7b1e77 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.151018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 152/299] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:21.174388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0b256-54c6-45b6-992e-5929b392d059 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:21.183440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.184127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.184404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.184708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.185485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:21.185762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:21.187248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:21.200095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 148/300] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:21.204160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:21.289782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0b256-54c6-45b6-992e-5929b392d059 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.314167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7007-e756-4559-ae94-958b53ba22e6 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.324941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a799ee-7a81-4ed9-af6c-eaba02a6c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.326016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a799ee-7a81-4ed9-af6c-eaba02a6c06f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.326516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a799ee-7a81-4ed9-af6c-eaba02a6c06f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.327059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a799ee-7a81-4ed9-af6c-eaba02a6c06f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.328305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a799ee-7a81-4ed9-af6c-eaba02a6c06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:21.329793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a799ee-7a81-4ed9-af6c-eaba02a6c06f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:21.332721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 153/301] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:21.332721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f0c6-ebdb-4be3-965b-748a7e4edc83 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.333315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f0c6-ebdb-4be3-965b-748a7e4edc83 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.333440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f0c6-ebdb-4be3-965b-748a7e4edc83 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.334559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 154/302] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:21.338306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f0c6-ebdb-4be3-965b-748a7e4edc83 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:21.347713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3158f-588b-4160-9707-ef4d2560dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.348602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3158f-588b-4160-9707-ef4d2560dc1f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.348923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3158f-588b-4160-9707-ef4d2560dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.349209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3158f-588b-4160-9707-ef4d2560dc1f None admin] PATH_INFO: `/v3/users/47a7d5cfbd584770944f7524cdca0370` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.350404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3158f-588b-4160-9707-ef4d2560dc1f None admin] RBAC: Authorizing `identity:get_user(user_id=47a7d5cfbd584770944f7524cdca0370)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:21.351849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3158f-588b-4160-9707-ef4d2560dc1f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:21.353870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 149/303] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:21 2022] GET /identity/v3/users/47a7d5cfbd584770944f7524cdca0370 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:21.355092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef6446-ad88-450f-91be-247d05b47a44 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.355409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef6446-ad88-450f-91be-247d05b47a44 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.355663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef6446-ad88-450f-91be-247d05b47a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.371635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-08ef6446-ad88-450f-91be-247d05b47a44 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:21.372860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-08ef6446-ad88-450f-91be-247d05b47a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:21.444697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 150/304] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:21.444697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef6446-ad88-450f-91be-247d05b47a44 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:21.463258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f0c6-ebdb-4be3-965b-748a7e4edc83 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.495555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.496223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.496510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.496806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] PATH_INFO: `/v3/groups` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.497501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:21.498960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:21.521376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 155/305] 10.222.0.52 () {60 vars in 1134 bytes} [Tue May 10 18:44:21 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:44:21.522540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:21.539759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef6446-ad88-450f-91be-247d05b47a44 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.580767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.582163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.582671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.583128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] PATH_INFO: `/v3/system/users/47a7d5cfbd584770944f7524cdca0370/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.585091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=47a7d5cfbd584770944f7524cdca0370, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:21.586929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:21.598588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 151/306] 10.222.0.52 () {58 vars in 1334 bytes} [Tue May 10 18:44:21 2022] PUT /identity/v3/system/users/47a7d5cfbd584770944f7524cdca0370/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:21.654733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331be815-7e38-4983-8145-788daf08cef7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.695685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.696906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.697337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.697755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.710725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:21.719320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:21.720467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:21.721544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:21.724122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 156/307] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:21.730557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:21.845515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5c4a-7cd4-43a6-ac06-5c2a38b5b964 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:21.885288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:21.886378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:21.886653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:21.886922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:21.887684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:21.887977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:21.889412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:21.898127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 152/308] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:21.903709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:22.003567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bcc84-79a3-417a-9296-b6e9f3992617 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:22.036746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b218140-2ef8-401f-9e5b-42c19a9bbeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:22.037641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218140-2ef8-401f-9e5b-42c19a9bbeba None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:22.037915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218140-2ef8-401f-9e5b-42c19a9bbeba None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:22.038186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218140-2ef8-401f-9e5b-42c19a9bbeba None admin] PATH_INFO: `/v3/users/ec7a4df493284e02ae732b4c618c9300` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:22.052146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218140-2ef8-401f-9e5b-42c19a9bbeba None admin] RBAC: Authorizing `identity:get_user(user_id=ec7a4df493284e02ae732b4c618c9300)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:22.053645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218140-2ef8-401f-9e5b-42c19a9bbeba None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:22.055646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 157/309] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:21 2022] GET /identity/v3/users/ec7a4df493284e02ae732b4c618c9300 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:22.061482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:22.160311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a69e-a85e-4415-aac2-439e0dbf3680 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:22.193385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7145e9-c8fe-41f2-9af6-67a91a92356a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:22.194086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7145e9-c8fe-41f2-9af6-67a91a92356a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:22.194371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7145e9-c8fe-41f2-9af6-67a91a92356a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:22.194650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7145e9-c8fe-41f2-9af6-67a91a92356a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:22.195514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7145e9-c8fe-41f2-9af6-67a91a92356a None admin] RBAC: Adding query filter params (role.id=e0d63a4c4aae4c998504ffee4b2664be, user.id=ec7a4df493284e02ae732b4c618c9300, scope.system=all) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:22.195830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7145e9-c8fe-41f2-9af6-67a91a92356a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:22.197394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7145e9-c8fe-41f2-9af6-67a91a92356a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:22.203791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 153/310] 10.222.0.52 () {56 vars in 1308 bytes} [Tue May 10 18:44:22 2022] GET /identity/v3/role_assignments?user.id=ec7a4df493284e02ae732b4c618c9300&scope.system=all&role.id=e0d63a4c4aae4c998504ffee4b2664be => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:22.394399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996516da-31c7-4248-bf3a-96be677818d8 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:22.394793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996516da-31c7-4248-bf3a-96be677818d8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:22.394983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996516da-31c7-4248-bf3a-96be677818d8 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:22.396343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 158/311] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:22.401829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f342d-74e4-4fbd-a3ff-76f9aa036117 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:22.402112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f342d-74e4-4fbd-a3ff-76f9aa036117 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:22.402387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f342d-74e4-4fbd-a3ff-76f9aa036117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:22.422307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-229f342d-74e4-4fbd-a3ff-76f9aa036117 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:22.423824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-229f342d-74e4-4fbd-a3ff-76f9aa036117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:22.500345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 154/312] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:22.523583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996516da-31c7-4248-bf3a-96be677818d8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:22.624352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996516da-31c7-4248-bf3a-96be677818d8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:22.656960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079708-afce-484c-937a-e920a6653caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:22.657763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079708-afce-484c-937a-e920a6653caf None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:22.658037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079708-afce-484c-937a-e920a6653caf None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:22.658303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079708-afce-484c-937a-e920a6653caf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:22.668383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70079708-afce-484c-937a-e920a6653caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-70079708-afce-484c-937a-e920a6653caf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:22.676219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:22.677135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:22.677929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 159/313] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:22.683486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f342d-74e4-4fbd-a3ff-76f9aa036117 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:22.785167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f342d-74e4-4fbd-a3ff-76f9aa036117 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:22.821155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:22.821849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:22.822124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:22.822401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:22.823170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:22.823471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:22.824913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:22.833372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 155/314] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:22.839749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079708-afce-484c-937a-e920a6653caf None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:22.948304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079708-afce-484c-937a-e920a6653caf None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:22.981506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:22.982450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:22.982776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:22.983111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] PATH_INFO: `/v3/users/71866a4fa6614938a83db9e028ee2853` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:22.984305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] RBAC: Authorizing `identity:get_user(user_id=71866a4fa6614938a83db9e028ee2853)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:22.985807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:22.987734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 160/315] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:22 2022] GET /identity/v3/users/71866a4fa6614938a83db9e028ee2853 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:22.993439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:23.094696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45543f06-e8b7-4254-960e-d99ae709c9d5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:23.127045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:23.127702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:23.127993 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:23.128264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:23.193916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:23.196024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:23.292623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 156/316] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:23.297944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:23.401171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af93ea-a2d0-41ec-89d1-3f025da7d65d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:23.435197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687d261-5005-4c96-ba9c-fe141b09ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:23.436494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687d261-5005-4c96-ba9c-fe141b09ba71 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:23.436992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687d261-5005-4c96-ba9c-fe141b09ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:23.437461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687d261-5005-4c96-ba9c-fe141b09ba71 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:23.438854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687d261-5005-4c96-ba9c-fe141b09ba71 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:23.440509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687d261-5005-4c96-ba9c-fe141b09ba71 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:23.442790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 161/317] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:23 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:23.448894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:23.553518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda4380-159f-484b-96ca-f048c46884db None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:23.587881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9597f8-ec72-4b6d-a515-519d803e21cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:23.588559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9597f8-ec72-4b6d-a515-519d803e21cd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:23.588872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9597f8-ec72-4b6d-a515-519d803e21cd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:23.589152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9597f8-ec72-4b6d-a515-519d803e21cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:23.589990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9597f8-ec72-4b6d-a515-519d803e21cd None admin] RBAC: Adding query filter params (role.id=e0d63a4c4aae4c998504ffee4b2664be, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a, user.id=71866a4fa6614938a83db9e028ee2853) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:23.590301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9597f8-ec72-4b6d-a515-519d803e21cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:23.591743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9597f8-ec72-4b6d-a515-519d803e21cd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:23.597819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 157/318] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:23 2022] GET /identity/v3/role_assignments?user.id=71866a4fa6614938a83db9e028ee2853&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=e0d63a4c4aae4c998504ffee4b2664be => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:23.855843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a6c8-db17-40f0-9f1b-c64494bcdb65 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:23.856343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a6c8-db17-40f0-9f1b-c64494bcdb65 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:23.856800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a6c8-db17-40f0-9f1b-c64494bcdb65 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:23.858737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 162/319] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:23.864548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b624f-d0f5-4ae9-ad5d-11bf3a81041d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:23.865093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b624f-d0f5-4ae9-ad5d-11bf3a81041d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:23.865556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b624f-d0f5-4ae9-ad5d-11bf3a81041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:23.883216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-802b624f-d0f5-4ae9-ad5d-11bf3a81041d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:23.884391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-802b624f-d0f5-4ae9-ad5d-11bf3a81041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:23.921235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f197b-f1d9-4aab-b8c3-fa8fb22039ed None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:23.921520 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f197b-f1d9-4aab-b8c3-fa8fb22039ed None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:23.921968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f197b-f1d9-4aab-b8c3-fa8fb22039ed None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:23.923336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 163/320] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:23.928544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa45bc-1279-4495-aec3-5086a70e4061 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:23.928894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa45bc-1279-4495-aec3-5086a70e4061 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:23.929183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa45bc-1279-4495-aec3-5086a70e4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:23.946351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2daa45bc-1279-4495-aec3-5086a70e4061 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:23.947609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2daa45bc-1279-4495-aec3-5086a70e4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:23.952406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 158/321] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:23.970059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b624f-d0f5-4ae9-ad5d-11bf3a81041d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.020940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 164/322] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:24.043985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa45bc-1279-4495-aec3-5086a70e4061 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.067978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b624f-d0f5-4ae9-ad5d-11bf3a81041d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.101116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.101922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.102195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.102456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.103640 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:24.105127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:24.106769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 159/323] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:24.112324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.146059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa45bc-1279-4495-aec3-5086a70e4061 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.186846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.188067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.188351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.188620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.199652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:24.207021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:24.207877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:24.209081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 165/324] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:24.213837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f799d4-dc35-409e-a021-8a8a41018bb1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.214041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.247494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.248173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.248450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.248814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] PATH_INFO: `/v3/groups` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.249525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:24.250968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:24.266795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 160/325] 10.222.0.52 () {60 vars in 1134 bytes} [Tue May 10 18:44:24 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:24.329690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa582d6-d183-41ce-8877-84c4fb73a68a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.367437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b6d60-3f54-4d84-a321-befa2dcc8b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.368105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6d60-3f54-4d84-a321-befa2dcc8b92 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.368392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6d60-3f54-4d84-a321-befa2dcc8b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.368667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6d60-3f54-4d84-a321-befa2dcc8b92 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.369464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6d60-3f54-4d84-a321-befa2dcc8b92 None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:24.369778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6d60-3f54-4d84-a321-befa2dcc8b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:24.371215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6d60-3f54-4d84-a321-befa2dcc8b92 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:24.384743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 166/326] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:24.387512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.499008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7eee52-0f10-4657-ae9d-72111c0b9bde None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.515495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0a8a-d6b0-4e39-8637-150fe2520063 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.515784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0a8a-d6b0-4e39-8637-150fe2520063 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.516061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0a8a-d6b0-4e39-8637-150fe2520063 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.517470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 167/327] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:24.522556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63491951-db37-4e9a-8f44-edc05af1d29f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.522929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63491951-db37-4e9a-8f44-edc05af1d29f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.523214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63491951-db37-4e9a-8f44-edc05af1d29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.533370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.534263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.534547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.534824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] PATH_INFO: `/v3/users/47a7d5cfbd584770944f7524cdca0370` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.536042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] RBAC: Authorizing `identity:get_user(user_id=47a7d5cfbd584770944f7524cdca0370)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:24.537535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:24.539205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 161/328] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:24 2022] GET /identity/v3/users/47a7d5cfbd584770944f7524cdca0370 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:24.543025 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-63491951-db37-4e9a-8f44-edc05af1d29f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:24.544633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-63491951-db37-4e9a-8f44-edc05af1d29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:24.545073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 168/329] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:24.647001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63491951-db37-4e9a-8f44-edc05af1d29f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.665128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e891e-aff2-41c5-b493-018facc34e3c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.705320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.706001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.706292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.706567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.707414 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] RBAC: Adding query filter params (role.id=e7ad4f242602439f80a3999084d931dd, user.id=47a7d5cfbd584770944f7524cdca0370, scope.system=all) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:24.707724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:24.709239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:24.723537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 162/330] 10.222.0.52 () {56 vars in 1308 bytes} [Tue May 10 18:44:24 2022] GET /identity/v3/role_assignments?user.id=47a7d5cfbd584770944f7524cdca0370&scope.system=all&role.id=e7ad4f242602439f80a3999084d931dd => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:24.765465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63491951-db37-4e9a-8f44-edc05af1d29f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.806838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.807741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.808081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.808354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.820510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:24.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:24.829763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:24.830549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 169/331] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:24.841628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:24.954265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8df7f4-5e12-44d4-90a8-5d1edd01477a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:24.987992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:24.988703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:24.988998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:24.989285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:24.990053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:24.990362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:24.991797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:25.000882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 163/332] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:25.006620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:25.131967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf86d-2fc5-46a9-853a-be7e81b1afdc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:25.169695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1586f6-f92c-4d12-8c28-a2ae2086ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:25.170658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1586f6-f92c-4d12-8c28-a2ae2086ff82 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:25.170945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1586f6-f92c-4d12-8c28-a2ae2086ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:25.171220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1586f6-f92c-4d12-8c28-a2ae2086ff82 None admin] PATH_INFO: `/v3/users/ec7a4df493284e02ae732b4c618c9300` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:25.172467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1586f6-f92c-4d12-8c28-a2ae2086ff82 None admin] RBAC: Authorizing `identity:get_user(user_id=ec7a4df493284e02ae732b4c618c9300)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:25.173954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1586f6-f92c-4d12-8c28-a2ae2086ff82 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:25.175952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 170/333] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:25 2022] GET /identity/v3/users/ec7a4df493284e02ae732b4c618c9300 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:25.181650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:25.289175 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee861-2d90-4514-8ac4-2d13a0409a0c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:25.322343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467629f-fb7b-42bd-9b2d-3e4e14bb6b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:25.323225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467629f-fb7b-42bd-9b2d-3e4e14bb6b6f None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:25.323507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467629f-fb7b-42bd-9b2d-3e4e14bb6b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:25.323785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467629f-fb7b-42bd-9b2d-3e4e14bb6b6f None admin] PATH_INFO: `/v3/system/users/ec7a4df493284e02ae732b4c618c9300/roles/e0d63a4c4aae4c998504ffee4b2664be` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:25.325300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467629f-fb7b-42bd-9b2d-3e4e14bb6b6f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec7a4df493284e02ae732b4c618c9300, role_id=e0d63a4c4aae4c998504ffee4b2664be)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:25.326754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467629f-fb7b-42bd-9b2d-3e4e14bb6b6f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:25.340414 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 164/334] 10.222.0.52 () {58 vars in 1334 bytes} [Tue May 10 18:44:25 2022] PUT /identity/v3/system/users/ec7a4df493284e02ae732b4c618c9300/roles/e0d63a4c4aae4c998504ffee4b2664be => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:27.128934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca9c4-e8f4-452e-9040-8079fd63c5a2 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.130071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca9c4-e8f4-452e-9040-8079fd63c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.130561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca9c4-e8f4-452e-9040-8079fd63c5a2 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.132606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 171/335] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:27.139281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cadc4-fe3c-4f4b-9a23-4189de449897 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.140216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cadc4-fe3c-4f4b-9a23-4189de449897 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.140721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cadc4-fe3c-4f4b-9a23-4189de449897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.159534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-405cadc4-fe3c-4f4b-9a23-4189de449897 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:27.161266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-405cadc4-fe3c-4f4b-9a23-4189de449897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:27.232979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 165/336] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:27.256789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fca9c4-e8f4-452e-9040-8079fd63c5a2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:27.377587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fca9c4-e8f4-452e-9040-8079fd63c5a2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:27.412089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05605d7-ac70-4fa6-b0a2-6a13e518c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:27.413264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05605d7-ac70-4fa6-b0a2-6a13e518c556 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.413769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05605d7-ac70-4fa6-b0a2-6a13e518c556 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.414237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05605d7-ac70-4fa6-b0a2-6a13e518c556 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.440177 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05605d7-ac70-4fa6-b0a2-6a13e518c556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-a05605d7-ac70-4fa6-b0a2-6a13e518c556 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:27.448949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:27.449838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:27.450633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:27.456782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 172/337] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:27.459431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cadc4-fe3c-4f4b-9a23-4189de449897 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:27.508513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef503030-2de5-40d5-9b07-8fc8a55348ee None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.508883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef503030-2de5-40d5-9b07-8fc8a55348ee None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.509116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef503030-2de5-40d5-9b07-8fc8a55348ee None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.510522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 173/338] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:27.516543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3067789-61c9-4b22-a01a-b1df4e57e576 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.516898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3067789-61c9-4b22-a01a-b1df4e57e576 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.517180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3067789-61c9-4b22-a01a-b1df4e57e576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.540637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e3067789-61c9-4b22-a01a-b1df4e57e576 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:27.542158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e3067789-61c9-4b22-a01a-b1df4e57e576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:27.585968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cadc4-fe3c-4f4b-9a23-4189de449897 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:27.652091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:27.653177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.653657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.654148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.655209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:27.656957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:27.658551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:27.673916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 166/339] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:27.677672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:27.679995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 174/340] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:27.723214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3067789-61c9-4b22-a01a-b1df4e57e576 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:27.832062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cd3fe-da49-49fc-93f1-8c8165751a6e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:27.863960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3067789-61c9-4b22-a01a-b1df4e57e576 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:27.894263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:27.895172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.895590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.896011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.907713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759772f1-a375-4157-b768-43b69ed8718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:27.909002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759772f1-a375-4157-b768-43b69ed8718d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.909485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759772f1-a375-4157-b768-43b69ed8718d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.910909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759772f1-a375-4157-b768-43b69ed8718d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.934519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759772f1-a375-4157-b768-43b69ed8718d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-759772f1-a375-4157-b768-43b69ed8718d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:27.943890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:27.949579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:27.950425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:27.951485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 175/341] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:27.952508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecef33-a270-41c5-908e-a52d18600cae None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.953191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecef33-a270-41c5-908e-a52d18600cae None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.953191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecef33-a270-41c5-908e-a52d18600cae None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.954812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 176/342] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:27.959851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68454-5e4c-4a90-944b-e2fbadc79282 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:27.960131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68454-5e4c-4a90-944b-e2fbadc79282 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:27.960433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68454-5e4c-4a90-944b-e2fbadc79282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:27.983808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-d1d68454-5e4c-4a90-944b-e2fbadc79282 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:27.985038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d1d68454-5e4c-4a90-944b-e2fbadc79282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:28.057528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:28.059494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:28.066539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 177/343] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:28.067448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d68454-5e4c-4a90-944b-e2fbadc79282 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:28.169597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 167/344] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:28.171554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:28.189454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d68454-5e4c-4a90-944b-e2fbadc79282 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:28.229458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:28.230199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.230487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.230775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.231575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:28.231871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:28.237191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:28.248319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 178/345] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:28.249288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:28.276157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4165a4b-3bc9-4881-8fbf-571ae65f125d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:28.312423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:28.313362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.313643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.313914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.325133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:28.332926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:28.334035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:28.335046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:28.337157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 168/346] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:28.338262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:28.439679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f8fd-13df-4373-8268-23faacdc031b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:28.466503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed031013-ff74-4c03-a217-8a8098c70aed None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:28.481442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:28.482120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.482407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.482685 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.511621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:28.512906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.513386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.514422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.516547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:28.518499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:28.520805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 179/347] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:28 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:28.522368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:28.584779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:28.587070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:28.644073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044172b9-dc10-47b0-b432-8a7d93013168 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:28.678700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dcf78-603f-4cd4-b510-f94f61ba36d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:28.679628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dcf78-603f-4cd4-b510-f94f61ba36d5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.680079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dcf78-603f-4cd4-b510-f94f61ba36d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.680494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dcf78-603f-4cd4-b510-f94f61ba36d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.682039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dcf78-603f-4cd4-b510-f94f61ba36d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:28.682556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dcf78-603f-4cd4-b510-f94f61ba36d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:28.684150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dcf78-603f-4cd4-b510-f94f61ba36d5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:28.698232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 180/348] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:28.700168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aaf31-29bf-419c-b118-5c46fde4e569 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.700702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aaf31-29bf-419c-b118-5c46fde4e569 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.701219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aaf31-29bf-419c-b118-5c46fde4e569 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.703235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 181/349] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:28.704330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aaf31-29bf-419c-b118-5c46fde4e569 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:28.716204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 169/350] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:28.717312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:28.825498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aaf31-29bf-419c-b118-5c46fde4e569 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:28.840816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc2c26-7f35-4ea7-b4f9-ab4064c074af None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:28.875313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:28.876366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.876869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.877332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.878399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72f2bd-b32a-4956-a6bb-4632f5250797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:28.879474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72f2bd-b32a-4956-a6bb-4632f5250797 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.879903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72f2bd-b32a-4956-a6bb-4632f5250797 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.880314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72f2bd-b32a-4956-a6bb-4632f5250797 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.889018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72f2bd-b32a-4956-a6bb-4632f5250797 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:28.891136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72f2bd-b32a-4956-a6bb-4632f5250797 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:28.894139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 182/351] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:28 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:28.896289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a57b-7094-463b-b223-9176a2527a3c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:28.896759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a57b-7094-463b-b223-9176a2527a3c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:28.897177 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a57b-7094-463b-b223-9176a2527a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:28.920070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6103a57b-7094-463b-b223-9176a2527a3c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:28.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6103a57b-7094-463b-b223-9176a2527a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:28.958056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:28.958874 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.015614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 183/352] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:29.016785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a57b-7094-463b-b223-9176a2527a3c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.102628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 170/353] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:29.103655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.140581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a57b-7094-463b-b223-9176a2527a3c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.184337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486c62d-9d60-4b44-83ac-537b8912e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.186634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c62d-9d60-4b44-83ac-537b8912e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.187093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c62d-9d60-4b44-83ac-537b8912e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.187377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c62d-9d60-4b44-83ac-537b8912e9c3 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.189990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486c62d-9d60-4b44-83ac-537b8912e9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:29.191463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486c62d-9d60-4b44-83ac-537b8912e9c3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.193277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 184/354] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:29.194499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bf48-7f10-48b8-9d67-e80356f58c7a None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.194780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bf48-7f10-48b8-9d67-e80356f58c7a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.195056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bf48-7f10-48b8-9d67-e80356f58c7a None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.196320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 185/355] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:29.197004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bf48-7f10-48b8-9d67-e80356f58c7a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.248721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b959e7-da24-4d06-b5d9-d4150f842b8d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.288386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.289080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.289367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.289650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.290488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=53a50937bcf747f58de9c47b2be53f10) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:29.290803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:29.292255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.300760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 171/356] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:29.301671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.335867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bf48-7f10-48b8-9d67-e80356f58c7a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.383173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.384013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.384287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.384568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.398347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:29.406514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:29.407511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:29.408426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 186/357] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:29.409162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.427231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1c3eb-703f-46f2-9fd7-9787aeaf0fb1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.473415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99a44a-4f26-479b-b1d5-b74a63be8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.474307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a44a-4f26-479b-b1d5-b74a63be8d81 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.474591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a44a-4f26-479b-b1d5-b74a63be8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.474865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a44a-4f26-479b-b1d5-b74a63be8d81 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.476298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99a44a-4f26-479b-b1d5-b74a63be8d81 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:29.478413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99a44a-4f26-479b-b1d5-b74a63be8d81 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.480899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 172/358] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:29.483043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7109e-8233-44d5-a782-dfce8a6c3709 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.483683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7109e-8233-44d5-a782-dfce8a6c3709 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.484243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7109e-8233-44d5-a782-dfce8a6c3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.509624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-25f7109e-8233-44d5-a782-dfce8a6c3709 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:29.509624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-25f7109e-8233-44d5-a782-dfce8a6c3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:29.546538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381143-d0f0-4c01-b5e5-15414c6cd733 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.590784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 173/359] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:29.592788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde9c5f-8489-4c90-bc85-98ebd8bfb5c1 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.593275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde9c5f-8489-4c90-bc85-98ebd8bfb5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.593750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.593979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde9c5f-8489-4c90-bc85-98ebd8bfb5c1 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.594631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.594915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.595192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.596402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 174/360] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:29.596513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:29.597522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde9c5f-8489-4c90-bc85-98ebd8bfb5c1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.598207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.599867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 187/361] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:29.601087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.716718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde9c5f-8489-4c90-bc85-98ebd8bfb5c1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.720638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1356ce-f8b8-4a4a-8026-1d2edb312b40 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.761222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.761868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.762149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.762423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.763187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:29.763508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:29.764968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.767621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda4e50-74f4-422b-a913-45ab254768a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.768501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda4e50-74f4-422b-a913-45ab254768a2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.768847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda4e50-74f4-422b-a913-45ab254768a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.769122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda4e50-74f4-422b-a913-45ab254768a2 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.773266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda4e50-74f4-422b-a913-45ab254768a2 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:29.775021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda4e50-74f4-422b-a913-45ab254768a2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.776451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 188/362] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:29.784023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc15f4-2148-47ea-bf15-960ff90ceb0e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.784023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc15f4-2148-47ea-bf15-960ff90ceb0e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.784270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 175/363] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:29.784369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc15f4-2148-47ea-bf15-960ff90ceb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.784458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.801445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-17dc15f4-2148-47ea-bf15-960ff90ceb0e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:29.802859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-17dc15f4-2148-47ea-bf15-960ff90ceb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:29.883381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 189/364] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:29.884237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc15f4-2148-47ea-bf15-960ff90ceb0e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:29.898155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c027da-04cc-4dce-b553-80387fd4493e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:29.937790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:29.938875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:29.939424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:29.939856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:29.941438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=53a50937bcf747f58de9c47b2be53f10) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:29.942185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:29.944288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:29.956809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 176/365] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=e7ad4f242602439f80a3999084d931dd => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:29.956809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.002522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc15f4-2148-47ea-bf15-960ff90ceb0e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.040244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.041378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.041831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.042256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.055166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:30.066186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:30.067372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:30.068338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:30.070698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 190/366] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:30.071722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.077688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53012312-d227-4678-8c1f-66c3735b1448 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.131159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.131849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.132132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.132407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.133295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:30.133604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.135397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.142261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 177/367] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:29 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=e7ad4f242602439f80a3999084d931dd => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:30.143004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.194133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac129f-fb54-4edc-97eb-bd6261e73ffb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.232123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.233550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.234034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.234528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] PATH_INFO: `/v3/users/ec7a4df493284e02ae732b4c618c9300` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.236064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] RBAC: Authorizing `identity:get_user(user_id=ec7a4df493284e02ae732b4c618c9300)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.237901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.239890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 191/368] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/users/ec7a4df493284e02ae732b4c618c9300 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:30.240985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.253912 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b02308-d99d-41de-935c-55e9c36a9572 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.290652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.291409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.291681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.291955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.304942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:30.313052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:30.314026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:30.314871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 178/369] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:30.315626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.358756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d134-76e8-4108-ad2c-7c2241f8455b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.394478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.395446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.396005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.396482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.397635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:30.398153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.399767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.409688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 192/370] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:30.410794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.421304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8aa4c-638a-466f-b905-f20d7abbcee7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.459047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.459739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.460083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.460365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.461522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] RBAC: Adding query filter params (role.id=e0d63a4c4aae4c998504ffee4b2664be, user.id=ec7a4df493284e02ae732b4c618c9300, scope.system=all) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:30.461643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.463041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.477041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 179/371] 10.222.0.52 () {56 vars in 1308 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/role_assignments?user.id=ec7a4df493284e02ae732b4c618c9300&scope.system=all&role.id=e0d63a4c4aae4c998504ffee4b2664be => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:30.477997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.528495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5cc2e-3573-4cdc-bef1-d2626cee2819 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.565446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.566494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.566998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.567485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.568503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:30.569049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.570706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.581123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 193/372] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:30.587298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.592224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240561-ef8a-4b0e-9532-a3ec4387f7dc None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.629169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.629911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.630194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.630470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.696283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028951f-f26e-4fb5-89a1-472de8fb19f1 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.704649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.706273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.732239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.733545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.734047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.734522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.803150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.805082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.812823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 180/373] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:30.821719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.918885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 194/374] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:44:30.924794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:30.954338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216e4e-33ec-4315-95be-1553de2393c5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:30.989566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:30.990725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:30.991280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:30.991753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:30.993319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:30.994965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:30.999597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 181/375] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:31.005252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:31.046574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8ff3f-3e68-4c9d-a7ac-76f85ebcc9a5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:31.095472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:31.096293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:31.096574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:31.096876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] PATH_INFO: `/v3/projects/55014cd93ec34248b9cee6790f6f8c90` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:31.098880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] RBAC: Authorizing `identity:get_project(project_id=55014cd93ec34248b9cee6790f6f8c90)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:31.100650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:31.103464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 195/376] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:30 2022] GET /identity/v3/projects/55014cd93ec34248b9cee6790f6f8c90 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:31.108473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:31.121282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a5d0b-3494-4cf1-bbc5-99b5f6a9dea9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:31.163062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:31.164345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:31.168910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:31.169451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:31.171024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:31.172709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:31.174620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 182/377] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:31 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:31.182352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:31.223204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9e3d-5c5c-43c8-afc1-109b46f76f97 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:31.263082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:31.264126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:31.264341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:31.264600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] PATH_INFO: `/v3/groups/d557ab5852db42b3ac3e1b1eb376ab6f` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:31.278253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] RBAC: Authorizing `identity:get_group(group_id=d557ab5852db42b3ac3e1b1eb376ab6f)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:31.278253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:31.279834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 196/378] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:31 2022] GET /identity/v3/groups/d557ab5852db42b3ac3e1b1eb376ab6f => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:31.304830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:31.313015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a580fa-a552-44d7-9525-8bc2bf8a2aa4 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:31.352116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6412c-9f7c-4ea0-b7ca-2fe85f796c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:31.353180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6412c-9f7c-4ea0-b7ca-2fe85f796c79 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:31.353682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6412c-9f7c-4ea0-b7ca-2fe85f796c79 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:31.354170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6412c-9f7c-4ea0-b7ca-2fe85f796c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:31.355206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6412c-9f7c-4ea0-b7ca-2fe85f796c79 None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:31.355730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6412c-9f7c-4ea0-b7ca-2fe85f796c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:31.357408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6412c-9f7c-4ea0-b7ca-2fe85f796c79 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:31.369127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 183/379] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:31 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:31.431014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3db8-0081-4b67-9ed5-b41e188a3d83 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:31.468696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e670b44-7407-4916-a2fd-3e88fd9a14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:31.469532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670b44-7407-4916-a2fd-3e88fd9a14b6 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:31.469865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670b44-7407-4916-a2fd-3e88fd9a14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:31.470145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670b44-7407-4916-a2fd-3e88fd9a14b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:31.471002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670b44-7407-4916-a2fd-3e88fd9a14b6 None admin] RBAC: Adding query filter params (group.id=d557ab5852db42b3ac3e1b1eb376ab6f, role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=55014cd93ec34248b9cee6790f6f8c90) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:31.471324 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670b44-7407-4916-a2fd-3e88fd9a14b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:31.472887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670b44-7407-4916-a2fd-3e88fd9a14b6 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:31.479138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 197/380] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:31 2022] GET /identity/v3/role_assignments?group.id=d557ab5852db42b3ac3e1b1eb376ab6f&scope.project.id=55014cd93ec34248b9cee6790f6f8c90&role.id=4222709f8e2845f1943f943370bcd122 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:32.114710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78dfac-3219-47d7-b57e-b95d5b6addac None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:32.115093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78dfac-3219-47d7-b57e-b95d5b6addac None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:32.115283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78dfac-3219-47d7-b57e-b95d5b6addac None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:32.116840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 184/381] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:32.122281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14828-5323-4cd4-b21d-38a4046485c2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:32.122571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14828-5323-4cd4-b21d-38a4046485c2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:32.122851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14828-5323-4cd4-b21d-38a4046485c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:32.145756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5ad14828-5323-4cd4-b21d-38a4046485c2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:32.146987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5ad14828-5323-4cd4-b21d-38a4046485c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:32.224757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 198/382] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:32.254410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78dfac-3219-47d7-b57e-b95d5b6addac None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:32.382447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78dfac-3219-47d7-b57e-b95d5b6addac None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:32.424180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:32.425036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:32.425323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:32.425596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:32.442083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:32.450378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:32.451256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:32.452095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 185/383] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:32.462490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14828-5323-4cd4-b21d-38a4046485c2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:32.616486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14828-5323-4cd4-b21d-38a4046485c2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:32.664399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:32.665448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:32.666020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:32.666496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:32.667452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:32.667960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:32.669567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:32.680566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 199/384] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:32.686676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:32.819158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c912fa8-745a-4785-8652-b4c8a8a50008 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:32.860538 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:32.861472 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:32.861766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:32.862043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:32.863374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:32.864901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:32.866951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 186/385] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:32 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:32.877909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:33.016444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f4eb5-742b-458e-a4f2-e4fffc2cb5b4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:33.059785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c6a3-3fd9-4a55-ac08-1fcc84427298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:33.060702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c6a3-3fd9-4a55-ac08-1fcc84427298 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.061241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c6a3-3fd9-4a55-ac08-1fcc84427298 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.061525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c6a3-3fd9-4a55-ac08-1fcc84427298 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.065453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c6a3-3fd9-4a55-ac08-1fcc84427298 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:33.066918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c6a3-3fd9-4a55-ac08-1fcc84427298 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:33.068662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 200/386] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:32 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:33.074520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:33.084151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30a87-8844-4476-874c-bff4751f6e7d None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.084440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30a87-8844-4476-874c-bff4751f6e7d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.084733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30a87-8844-4476-874c-bff4751f6e7d None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.088104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 201/387] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:33.091744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc677508-7a91-418c-996d-0d39d58b4857 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.092088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc677508-7a91-418c-996d-0d39d58b4857 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.092404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc677508-7a91-418c-996d-0d39d58b4857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.120033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-cc677508-7a91-418c-996d-0d39d58b4857 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:33.121253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cc677508-7a91-418c-996d-0d39d58b4857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:33.244221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142d49b-9f9b-431c-b52c-54fc3ec6ded1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:33.260984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 202/388] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:33.288413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:33.289272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.289559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.289838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10/groups/ebbad12327c54dd0acd327dd98851b2b/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.293972 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] RBAC: Authorizing `identity:create_grant(project_id=53a50937bcf747f58de9c47b2be53f10, group_id=ebbad12327c54dd0acd327dd98851b2b, role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:33.295488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:33.303060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc677508-7a91-418c-996d-0d39d58b4857 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:33.334804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 187/389] 10.222.0.52 () {58 vars in 1442 bytes} [Tue May 10 18:44:33 2022] PUT /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10/groups/ebbad12327c54dd0acd327dd98851b2b/roles/08dee391f7e34431ad610ccbb9b49349 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:33.427189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc677508-7a91-418c-996d-0d39d58b4857 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:33.468327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00400c-195e-43cd-baf0-59627800ac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:33.469300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00400c-195e-43cd-baf0-59627800ac16 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.469576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00400c-195e-43cd-baf0-59627800ac16 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.469849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00400c-195e-43cd-baf0-59627800ac16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.484820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00400c-195e-43cd-baf0-59627800ac16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-ff00400c-195e-43cd-baf0-59627800ac16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:33.492696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:33.493671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:33.494459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 203/390] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:33.500311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:33.666402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490a55-ac31-4a26-a491-d6f39a1d108c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:33.673288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a34b1-582b-4d1a-8968-c4c450bc2e3b None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.673925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a34b1-582b-4d1a-8968-c4c450bc2e3b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.674415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a34b1-582b-4d1a-8968-c4c450bc2e3b None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.676235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 204/391] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:33.682350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443fe3-f7a6-411b-97c8-b6433d444380 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.683371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443fe3-f7a6-411b-97c8-b6433d444380 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.683873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443fe3-f7a6-411b-97c8-b6433d444380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.704096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-84443fe3-f7a6-411b-97c8-b6433d444380 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:33.706332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-84443fe3-f7a6-411b-97c8-b6433d444380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:33.710367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:33.711055 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.711386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.711653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.712426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] RBAC: Adding query filter params (name=member) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:33.713703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:33.714145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:33.728777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 188/392] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:33.733820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:33.812149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 205/393] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:33.835611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443fe3-f7a6-411b-97c8-b6433d444380 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:33.849758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb440-d778-4808-abb7-5d06c3927549 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:33.898220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:33.899463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:33.899953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:33.900433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:33.903897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:33.906782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:33.908700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 189/394] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:33 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:33.915801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.009034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443fe3-f7a6-411b-97c8-b6433d444380 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.070205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.071381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.071871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.072351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.087665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf849abc-48e5-44f1-a2ea-b106b4918d60 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.090851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:34.104791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:34.105730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:34.106504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:34.112560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 206/395] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:34.121639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.203410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.204369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.204628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.205114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.206477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:34.208092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:34.210008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 190/396] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:33 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:34.215752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.248143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd1520-c411-4b32-afc4-dc3a8e058cb1 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.292153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.293662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.294163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.294641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.295794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:34.296296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:34.297911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:34.314327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 207/397] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:34.317864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.350781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2cb60-e1a4-422a-8a80-d4c68b45fe2b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.388215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dba58-c6ee-4e2e-93e3-8c626fae6ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.389623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dba58-c6ee-4e2e-93e3-8c626fae6ab0 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.390054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dba58-c6ee-4e2e-93e3-8c626fae6ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.390474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dba58-c6ee-4e2e-93e3-8c626fae6ab0 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/groups/ebbad12327c54dd0acd327dd98851b2b/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.392664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dba58-c6ee-4e2e-93e3-8c626fae6ab0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be83ad5dbb644e3b505529ecd3d8b9a, group_id=ebbad12327c54dd0acd327dd98851b2b, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:34.394367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dba58-c6ee-4e2e-93e3-8c626fae6ab0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:34.409827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 191/398] 10.222.0.52 () {58 vars in 1442 bytes} [Tue May 10 18:44:34 2022] PUT /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/groups/ebbad12327c54dd0acd327dd98851b2b/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:34.411853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bba15-b164-4b43-81bf-3d16b6492b9a None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.412402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bba15-b164-4b43-81bf-3d16b6492b9a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.412964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bba15-b164-4b43-81bf-3d16b6492b9a None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.414827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 192/399] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:34.421636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ba7d-4297-4c72-a959-91914811a533 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.422305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ba7d-4297-4c72-a959-91914811a533 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.422799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ba7d-4297-4c72-a959-91914811a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.423319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9867b-c944-41f9-9a86-1e89c2ca757f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.444628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-2972ba7d-4297-4c72-a959-91914811a533 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:34.446355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2972ba7d-4297-4c72-a959-91914811a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:34.465156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.466410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.466701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.467160 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.469038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:34.470816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:34.473138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 208/400] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:34 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:34.478796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.537291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 193/401] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:34.572093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ba7d-4297-4c72-a959-91914811a533 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.600338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05afb3-643e-4485-a567-f79c3cca718c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.638767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79637-a88d-48e8-8451-ac34343e0a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.639712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79637-a88d-48e8-8451-ac34343e0a36 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.639989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79637-a88d-48e8-8451-ac34343e0a36 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.640259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79637-a88d-48e8-8451-ac34343e0a36 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.641762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79637-a88d-48e8-8451-ac34343e0a36 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:34.643814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79637-a88d-48e8-8451-ac34343e0a36 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:34.646523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 209/402] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:34 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:34.653914 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340773b-9396-44d8-96ab-ebc115f9be8a None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.654676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340773b-9396-44d8-96ab-ebc115f9be8a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.654958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340773b-9396-44d8-96ab-ebc115f9be8a None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.656974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 210/403] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:34.657676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340773b-9396-44d8-96ab-ebc115f9be8a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.684174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ba7d-4297-4c72-a959-91914811a533 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.731315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ff80-fdda-4dc6-8d23-75a65133ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.733127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ff80-fdda-4dc6-8d23-75a65133ef64 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.733849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ff80-fdda-4dc6-8d23-75a65133ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.734340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ff80-fdda-4dc6-8d23-75a65133ef64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.748417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ff80-fdda-4dc6-8d23-75a65133ef64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4295ff80-fdda-4dc6-8d23-75a65133ef64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:34.758865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:34.759795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:34.760987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:34.763550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 194/404] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:34.765069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02edc0-bed1-4e23-985e-f33ec0627df1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.765619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02edc0-bed1-4e23-985e-f33ec0627df1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.766099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02edc0-bed1-4e23-985e-f33ec0627df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.771914 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340773b-9396-44d8-96ab-ebc115f9be8a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:34.783532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4a02edc0-bed1-4e23-985e-f33ec0627df1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:34.785457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4a02edc0-bed1-4e23-985e-f33ec0627df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:34.809521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:34.810440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:34.810740 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:34.811159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10/groups/ebbad12327c54dd0acd327dd98851b2b/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:34.813626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] RBAC: Authorizing `identity:create_grant(project_id=53a50937bcf747f58de9c47b2be53f10, group_id=ebbad12327c54dd0acd327dd98851b2b, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:34.815140 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:34.831403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 211/405] 10.222.0.52 () {58 vars in 1442 bytes} [Tue May 10 18:44:34 2022] PUT /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10/groups/ebbad12327c54dd0acd327dd98851b2b/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:34.832271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.864585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 195/406] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:34.946189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02edc0-bed1-4e23-985e-f33ec0627df1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:34.975024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7da15-f3a6-4770-b6f8-b84594c221cd None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.013238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.014000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.014286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.014563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.015767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:35.016079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:35.017958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:35.028098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 212/407] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:35.034088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:35.133305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02edc0-bed1-4e23-985e-f33ec0627df1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.141234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204696a6-1b52-4bf8-a4c9-18e7221768c1 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.170299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.171559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.172072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.172543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.175977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.177161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.177656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.179178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] PATH_INFO: `/v3/groups/d557ab5852db42b3ac3e1b1eb376ab6f` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.180049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] RBAC: Authorizing `identity:get_group(group_id=d557ab5852db42b3ac3e1b1eb376ab6f)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:35.181564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:35.183379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 213/408] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:35 2022] GET /identity/v3/groups/d557ab5852db42b3ac3e1b1eb376ab6f => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:35.189112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:35.193056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:35.201236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:35.202208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:35.203092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:35.209219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 196/409] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:35.216240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:35.303642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bfc82-c84e-4fd8-aee2-117445d3cf56 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.337793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.339033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.339525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.339988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] PATH_INFO: `/v3/projects/55014cd93ec34248b9cee6790f6f8c90` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.341419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=55014cd93ec34248b9cee6790f6f8c90)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:35.343157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:35.345424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 214/410] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:35 2022] GET /identity/v3/projects/55014cd93ec34248b9cee6790f6f8c90 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:35.351218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:35.405561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74596762-c900-4feb-8c5a-9d98b13cd8a4 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.457245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5b4-1893-412f-a18f-d81af9d20ae4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.473959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.474656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.474942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.475217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.475982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:35.476290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:35.477703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:35.490372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.491338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.491686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.492029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] PATH_INFO: `/v3/projects/55014cd93ec34248b9cee6790f6f8c90/groups/d557ab5852db42b3ac3e1b1eb376ab6f/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.494122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] RBAC: Authorizing `identity:create_grant(project_id=55014cd93ec34248b9cee6790f6f8c90, group_id=d557ab5852db42b3ac3e1b1eb376ab6f, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:35.494683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 197/411] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:35.495859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:35.500515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:35.511400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 215/412] 10.222.0.52 () {58 vars in 1442 bytes} [Tue May 10 18:44:35 2022] PUT /identity/v3/projects/55014cd93ec34248b9cee6790f6f8c90/groups/d557ab5852db42b3ac3e1b1eb376ab6f/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:44:35.652148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb280-a291-48e4-b8e0-9040c48c4b02 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.699262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.700537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.701027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.701601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.705289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:35.706987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:35.708898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 198/413] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:35 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:35.714692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:35.857950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f62714-044b-4497-8b37-65867183b98d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:35.890709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514ac63-4c83-426f-9f49-8bb7f755d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:35.891585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ac63-4c83-426f-9f49-8bb7f755d709 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:35.891863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ac63-4c83-426f-9f49-8bb7f755d709 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:35.892133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ac63-4c83-426f-9f49-8bb7f755d709 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:35.893339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514ac63-4c83-426f-9f49-8bb7f755d709 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:35.894779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514ac63-4c83-426f-9f49-8bb7f755d709 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:35.896782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 216/414] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:35 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:35.902390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:36.041794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bafed-efde-459c-8c4e-43677a18916a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:36.089205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae849f-04ac-454c-b63a-f23088524bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:36.090405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae849f-04ac-454c-b63a-f23088524bef None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:36.090861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae849f-04ac-454c-b63a-f23088524bef None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:36.091276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae849f-04ac-454c-b63a-f23088524bef None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/groups/ebbad12327c54dd0acd327dd98851b2b/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:36.098493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae849f-04ac-454c-b63a-f23088524bef None admin] RBAC: Authorizing `identity:create_grant(project_id=1be83ad5dbb644e3b505529ecd3d8b9a, group_id=ebbad12327c54dd0acd327dd98851b2b, role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:36.100100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae849f-04ac-454c-b63a-f23088524bef None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:36.117983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 199/415] 10.222.0.52 () {58 vars in 1442 bytes} [Tue May 10 18:44:35 2022] PUT /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a/groups/ebbad12327c54dd0acd327dd98851b2b/roles/08dee391f7e34431ad610ccbb9b49349 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:36.471045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3381a-96f1-483d-8f5f-3eaf189aa972 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:36.471992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3381a-96f1-483d-8f5f-3eaf189aa972 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:36.472458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3381a-96f1-483d-8f5f-3eaf189aa972 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:36.474323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 217/416] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:36.480076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec284-bea4-4cc7-9527-524747d10b93 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:36.480356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec284-bea4-4cc7-9527-524747d10b93 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:36.480629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec284-bea4-4cc7-9527-524747d10b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:36.500110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-80dec284-bea4-4cc7-9527-524747d10b93 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:36.501664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-80dec284-bea4-4cc7-9527-524747d10b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:36.571824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 200/417] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:36.595494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3381a-96f1-483d-8f5f-3eaf189aa972 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:36.758449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3381a-96f1-483d-8f5f-3eaf189aa972 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:36.799704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916aa23-58a7-4295-a3aa-84bc32176e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:36.800528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916aa23-58a7-4295-a3aa-84bc32176e71 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:36.800836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916aa23-58a7-4295-a3aa-84bc32176e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:36.801114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916aa23-58a7-4295-a3aa-84bc32176e71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:36.821583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916aa23-58a7-4295-a3aa-84bc32176e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-9916aa23-58a7-4295-a3aa-84bc32176e71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:36.829791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:36.830655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:36.831426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 218/418] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:36.838667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec284-bea4-4cc7-9527-524747d10b93 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:36.863249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d704-af3a-41b7-8e28-016b5417f2d9 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:36.863562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d704-af3a-41b7-8e28-016b5417f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:36.863819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d704-af3a-41b7-8e28-016b5417f2d9 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:36.865553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 219/419] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:36.870524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357299e1-ec26-41fe-b248-3370d60c410b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:36.870817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357299e1-ec26-41fe-b248-3370d60c410b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:36.871104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357299e1-ec26-41fe-b248-3370d60c410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:36.905691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-357299e1-ec26-41fe-b248-3370d60c410b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:36.906892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-357299e1-ec26-41fe-b248-3370d60c410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:36.948243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec284-bea4-4cc7-9527-524747d10b93 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:36.982211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:36.983273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:36.983759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:36.984238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:36.985259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:36.985749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:36.987324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:36.995785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 201/420] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:37.002220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:37.059412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 220/421] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:37.098210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357299e1-ec26-41fe-b248-3370d60c410b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:37.104543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92d524-7536-45a6-8f83-46843c9aee00 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:37.142610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:37.143700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.144172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.144634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.220880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:37.222937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:37.303363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357299e1-ec26-41fe-b248-3370d60c410b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:37.325270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 202/422] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:37.331168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:37.346756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:37.347578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.347874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.348164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.369929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:37.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:37.384698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:37.385949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 221/423] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:37.391202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:37.440149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65552566-18bf-4ee8-9d27-74cd5dc921e0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:37.479520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:37.480791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.481287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.481807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.483205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:37.484877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:37.487096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 203/424] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:37 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:37.492543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:37.493144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91262387-86c0-4afa-ade9-4204484f0322 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:37.534314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:37.535310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.535310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.535585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.536296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] RBAC: Adding query filter params (name=member) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:37.536606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:37.538017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:37.554742 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 222/425] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:37.559994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:37.595869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47283-870e-438b-8c73-0dc9195a78b6 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:37.629186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:37.630395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.630880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.631335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.632706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:37.634447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:37.641035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 204/426] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:37 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:37.642995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:37.749930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c209bc-6f3f-4dcc-8c9c-a0b726105665 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:37.776361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d254a-f771-4c57-a989-a066926736bc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:37.784688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2de14-320b-48a7-a78e-7e278b714318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:37.785624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2de14-320b-48a7-a78e-7e278b714318 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.786115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2de14-320b-48a7-a78e-7e278b714318 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.786593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2de14-320b-48a7-a78e-7e278b714318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.787644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2de14-320b-48a7-a78e-7e278b714318 None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=53a50937bcf747f58de9c47b2be53f10) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:37.788151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2de14-320b-48a7-a78e-7e278b714318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:37.789802 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2de14-320b-48a7-a78e-7e278b714318 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:37.796646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 205/427] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:37 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:37.844979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:37.845781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.846119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.846348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.917361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fcfc4-8be2-48a2-8613-3f8aa35363aa None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.918505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fcfc4-8be2-48a2-8613-3f8aa35363aa None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.918969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fcfc4-8be2-48a2-8613-3f8aa35363aa None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.920825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 206/428] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:37.927358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502760fd-fc09-477e-ba9d-4359a753d42b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:37.927945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502760fd-fc09-477e-ba9d-4359a753d42b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:37.928438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502760fd-fc09-477e-ba9d-4359a753d42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:37.952321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-502760fd-fc09-477e-ba9d-4359a753d42b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:37.954049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-502760fd-fc09-477e-ba9d-4359a753d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:37.969843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:37.971713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:38.061737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 207/429] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:38.092066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502760fd-fc09-477e-ba9d-4359a753d42b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.108471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 223/430] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:38.113856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.193568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502760fd-fc09-477e-ba9d-4359a753d42b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.217194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7d447-bb65-430d-b19d-bc1d39c67603 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.228026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.229151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.229650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.230165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.240928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:38.249230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:38.250222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 18:44:38.251051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:38.251642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.252439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.252747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.253031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.254268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:38.254481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 208/431] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:38.257645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:38.257645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 224/432] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:38.263756 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.263918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.373743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cb6c-2855-4ccd-a030-5f206e1a930a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.398081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885c045-f18b-4a28-9bb2-23845a2aa508 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.406937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.407706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.408412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.408412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.409210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] RBAC: Adding query filter params (name=member) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:38.409576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:38.411031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:38.424600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 209/433] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:38.425604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.437854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.439043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.439499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.439945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.441716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:38.444002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:38.446626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 225/434] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:38.452666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.537855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7c045-7444-40c0-922b-855db596075d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.566264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca8d42-4456-4428-9109-3947d3cc41a2 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.572821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.573495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.574227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.574499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.605288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89030-3d89-4be5-84f3-6f5cda55d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.605953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89030-3d89-4be5-84f3-6f5cda55d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.606235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89030-3d89-4be5-84f3-6f5cda55d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.606500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89030-3d89-4be5-84f3-6f5cda55d7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.607353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89030-3d89-4be5-84f3-6f5cda55d7e6 None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:38.607754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89030-3d89-4be5-84f3-6f5cda55d7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:38.609240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89030-3d89-4be5-84f3-6f5cda55d7e6 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:38.622373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 226/435] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=e7ad4f242602439f80a3999084d931dd => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:38.622373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2b2f-a20a-4f09-8c14-8018a5a71b26 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.622373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2b2f-a20a-4f09-8c14-8018a5a71b26 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.622373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2b2f-a20a-4f09-8c14-8018a5a71b26 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.622373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 227/436] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:38.624392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3518-60a2-4fb9-801d-476adb66bbf7 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.624615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3518-60a2-4fb9-801d-476adb66bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.624937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3518-60a2-4fb9-801d-476adb66bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.643419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-548b3518-60a2-4fb9-801d-476adb66bbf7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:38.644711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-548b3518-60a2-4fb9-801d-476adb66bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:38.659077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:38.660599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:38.734681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 228/437] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:38.757767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3518-60a2-4fb9-801d-476adb66bbf7 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.771467 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 210/438] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:38.778531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.879277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3518-60a2-4fb9-801d-476adb66bbf7 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.894421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ec8f7-6ed9-4e5d-92d6-3badd907e5cd None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:38.913346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.914153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.914431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.914705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.924392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:38.926610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928929-cfc5-466e-9019-8ae9a37bc7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:38.927470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928929-cfc5-466e-9019-8ae9a37bc7e6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.927748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928929-cfc5-466e-9019-8ae9a37bc7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.928021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928929-cfc5-466e-9019-8ae9a37bc7e6 None admin] PATH_INFO: `/v3/projects/53a50937bcf747f58de9c47b2be53f10` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.929238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928929-cfc5-466e-9019-8ae9a37bc7e6 None admin] RBAC: Authorizing `identity:get_project(project_id=53a50937bcf747f58de9c47b2be53f10)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:38.930687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928929-cfc5-466e-9019-8ae9a37bc7e6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:38.931940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:38.932932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:44:38.933733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:38.934331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 211/439] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/projects/53a50937bcf747f58de9c47b2be53f10 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:38.934409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 229/440] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:38.934474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad83d6-866a-42dd-985b-e9b661863db8 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.934474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad83d6-866a-42dd-985b-e9b661863db8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.934474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad83d6-866a-42dd-985b-e9b661863db8 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.935395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 212/441] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:38.939969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:38.941402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14b8c-0a44-43e0-bbdc-a27c1ba552ae None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:38.941686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14b8c-0a44-43e0-bbdc-a27c1ba552ae None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:38.941962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14b8c-0a44-43e0-bbdc-a27c1ba552ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:38.957783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-00d14b8c-0a44-43e0-bbdc-a27c1ba552ae None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:38.958975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-00d14b8c-0a44-43e0-bbdc-a27c1ba552ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:39.022492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 213/442] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:39.023290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d14b8c-0a44-43e0-bbdc-a27c1ba552ae None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.040783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b752-8719-4ea4-8413-7cbd4d989915 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.072240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.073148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.073428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.073700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.074880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.076357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.078168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 230/443] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:38 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:39.081585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.122176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d14b8c-0a44-43e0-bbdc-a27c1ba552ae None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.156119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.156719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.156998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.157268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.158024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:39.158330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.159720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.167876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 214/444] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:39.168652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.173017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f7f5-81c4-4fbd-82c2-47e0296afddc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.205695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.206509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.206791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.207064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.216847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:39.224774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:39.225954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 231/445] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:39.226769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.275014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c1b53-4bef-402c-b91d-0d5ad23e737a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.307517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.308177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.308457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.308724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.309560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=e7ad4f242602439f80a3999084d931dd, scope.project.id=53a50937bcf747f58de9c47b2be53f10) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:39.309870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.311349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.316999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 215/446] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=53a50937bcf747f58de9c47b2be53f10&role.id=e7ad4f242602439f80a3999084d931dd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:39.317963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.324210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b9596-950d-446f-92d6-af9eb1c3c388 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.361131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.361808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.362093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.362382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.423643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70103d6d-5b23-4475-8aaf-3209dc389d5b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.439407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.440922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.463274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.463994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.464284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.464563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.465405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:39.465701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.467183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.475938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 216/447] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:39.481548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.542970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 232/448] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:39.548895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.586691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a01c03-d2bb-4d62-bce0-fe97d47e2c9a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.625682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.626351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.626643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.626916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.649759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6010b-ae3a-4d4e-9248-1cb6633538ab None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.686511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.687722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.688201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.688808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] PATH_INFO: `/v3/projects/55014cd93ec34248b9cee6790f6f8c90` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.690234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] RBAC: Authorizing `identity:get_project(project_id=55014cd93ec34248b9cee6790f6f8c90)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.691900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.694696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 233/449] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/projects/55014cd93ec34248b9cee6790f6f8c90 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:39.700139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.706692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.708153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.807738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdd41f-746a-4a49-ba1b-54b084c51fbf None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.814667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 217/450] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:44:39.820277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.844305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.845539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.846039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.846511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] PATH_INFO: `/v3/groups/d557ab5852db42b3ac3e1b1eb376ab6f` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.847913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] RBAC: Authorizing `identity:get_group(group_id=d557ab5852db42b3ac3e1b1eb376ab6f)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.850434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.852567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 234/451] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/groups/d557ab5852db42b3ac3e1b1eb376ab6f => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:39.858134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:39.937246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2b11b-789b-4fad-a4e2-69f36992ff70 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.973942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62146b9b-6627-4f76-830f-2d22c3ec7976 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:39.974834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:39.975773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:39.975773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:39.976750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] PATH_INFO: `/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:39.978174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] RBAC: Authorizing `identity:get_project(project_id=1be83ad5dbb644e3b505529ecd3d8b9a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:39.979951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:39.981397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 218/452] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/projects/1be83ad5dbb644e3b505529ecd3d8b9a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:39.986975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:40.009705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:40.010371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:40.011018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:40.011294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:40.012132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] RBAC: Adding query filter params (group.id=d557ab5852db42b3ac3e1b1eb376ab6f, role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=55014cd93ec34248b9cee6790f6f8c90) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:40.012445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:40.014064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:40.020162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 235/453] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/role_assignments?group.id=d557ab5852db42b3ac3e1b1eb376ab6f&scope.project.id=55014cd93ec34248b9cee6790f6f8c90&role.id=4222709f8e2845f1943f943370bcd122 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:40.093397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63394307-6f31-44be-8661-6721e4f3c461 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:40.130807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1470429-fefc-4521-88e1-b3c7543a6fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:40.131708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1470429-fefc-4521-88e1-b3c7543a6fec None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:40.131997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1470429-fefc-4521-88e1-b3c7543a6fec None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:40.132267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1470429-fefc-4521-88e1-b3c7543a6fec None admin] PATH_INFO: `/v3/groups/ebbad12327c54dd0acd327dd98851b2b` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:40.133557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1470429-fefc-4521-88e1-b3c7543a6fec None admin] RBAC: Authorizing `identity:get_group(group_id=ebbad12327c54dd0acd327dd98851b2b)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:40.135017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1470429-fefc-4521-88e1-b3c7543a6fec None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:40.137097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 219/454] 10.222.0.52 () {56 vars in 1180 bytes} [Tue May 10 18:44:39 2022] GET /identity/v3/groups/ebbad12327c54dd0acd327dd98851b2b => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:40.143360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:40.248467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d197044-c9ea-4baa-9a62-11b4a31d1ac4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:40.284527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067beb43-1e65-4b78-8586-a0fad542ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:40.285297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067beb43-1e65-4b78-8586-a0fad542ca19 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:40.285582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067beb43-1e65-4b78-8586-a0fad542ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:40.285858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067beb43-1e65-4b78-8586-a0fad542ca19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:40.286729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067beb43-1e65-4b78-8586-a0fad542ca19 None admin] RBAC: Adding query filter params (group.id=ebbad12327c54dd0acd327dd98851b2b, role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:40.287065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067beb43-1e65-4b78-8586-a0fad542ca19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:40.288485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067beb43-1e65-4b78-8586-a0fad542ca19 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:40.294407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 236/455] 10.222.0.52 () {56 vars in 1376 bytes} [Tue May 10 18:44:40 2022] GET /identity/v3/role_assignments?group.id=ebbad12327c54dd0acd327dd98851b2b&scope.project.id=1be83ad5dbb644e3b505529ecd3d8b9a&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:42.969289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf15b5-16e4-46f8-a4d6-32f10273c74f None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:42.969811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf15b5-16e4-46f8-a4d6-32f10273c74f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:42.969811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf15b5-16e4-46f8-a4d6-32f10273c74f None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:42.971459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 220/456] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:42.977098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e299d-9c82-42e7-9705-dafbd3a44f00 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:42.977963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e299d-9c82-42e7-9705-dafbd3a44f00 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:42.978441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e299d-9c82-42e7-9705-dafbd3a44f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.001909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a73e299d-9c82-42e7-9705-dafbd3a44f00 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:43.003526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a73e299d-9c82-42e7-9705-dafbd3a44f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:43.099735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 237/457] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:43.138650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf15b5-16e4-46f8-a4d6-32f10273c74f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:43.205941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce45ae-f91c-44cf-bf91-df7959a6cd96 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.206216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce45ae-f91c-44cf-bf91-df7959a6cd96 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.206518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce45ae-f91c-44cf-bf91-df7959a6cd96 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.208374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 238/458] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:43.219277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9f62-827c-4c58-a27b-6a7a490e6571 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.219622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9f62-827c-4c58-a27b-6a7a490e6571 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.220071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9f62-827c-4c58-a27b-6a7a490e6571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.248015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c65c9f62-827c-4c58-a27b-6a7a490e6571 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:43.251487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c65c9f62-827c-4c58-a27b-6a7a490e6571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:43.307007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf15b5-16e4-46f8-a4d6-32f10273c74f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:43.338198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 239/459] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:43.342112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:43.343229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.343706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.344177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.355688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:43.357550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:43.375396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:43.376294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:43.377202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:43.377202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:43.377202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:43.377202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:43.379461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 221/460] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:43.389705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c9f62-827c-4c58-a27b-6a7a490e6571 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:43.394204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:43.570357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e833357-3da5-46d1-8166-8044af0ace02 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:43.635958 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92b2b9-6e2e-41d9-b0b3-af690efecd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:43.637361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b2b9-6e2e-41d9-b0b3-af690efecd71 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.637851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b2b9-6e2e-41d9-b0b3-af690efecd71 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.638340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b2b9-6e2e-41d9-b0b3-af690efecd71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.662151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c9f62-827c-4c58-a27b-6a7a490e6571 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:43.669898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92b2b9-6e2e-41d9-b0b3-af690efecd71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:43.672754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92b2b9-6e2e-41d9-b0b3-af690efecd71 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-9a92b2b9-6e2e-41d9-b0b3-af690efecd71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:43.707182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:43.708192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:43.709111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:43.709111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:43.709111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:43.709111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:43.710302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 222/461] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:43.715579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7b4c-35d8-4e88-8dc8-c8437dfa883d None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.715579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7b4c-35d8-4e88-8dc8-c8437dfa883d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.715579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7b4c-35d8-4e88-8dc8-c8437dfa883d None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.715579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 223/462] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:43.717073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7b4c-35d8-4e88-8dc8-c8437dfa883d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:43.721965 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9a646-ce1a-45d0-b1c3-7e7ed36b3c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:43.723000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9a646-ce1a-45d0-b1c3-7e7ed36b3c7b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.723481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9a646-ce1a-45d0-b1c3-7e7ed36b3c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.723956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9a646-ce1a-45d0-b1c3-7e7ed36b3c7b None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.724942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9a646-ce1a-45d0-b1c3-7e7ed36b3c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:43.725451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9a646-ce1a-45d0-b1c3-7e7ed36b3c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:43.727045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9a646-ce1a-45d0-b1c3-7e7ed36b3c7b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:43.739293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 240/463] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:43.745389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083e04-2e30-4e81-869e-6faba863fa45 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.745949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083e04-2e30-4e81-869e-6faba863fa45 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.746429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083e04-2e30-4e81-869e-6faba863fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.765781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8a083e04-2e30-4e81-869e-6faba863fa45 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:43.766978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8a083e04-2e30-4e81-869e-6faba863fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:43.826397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7b4c-35d8-4e88-8dc8-c8437dfa883d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:43.837769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 241/464] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:43.838872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a083e04-2e30-4e81-869e-6faba863fa45 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:43.871113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd6cc-468f-41ca-8e88-7d634e5c0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:43.872049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd6cc-468f-41ca-8e88-7d634e5c0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.872323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd6cc-468f-41ca-8e88-7d634e5c0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.872597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd6cc-468f-41ca-8e88-7d634e5c0ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.873400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd6cc-468f-41ca-8e88-7d634e5c0ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:43.873701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd6cc-468f-41ca-8e88-7d634e5c0ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:43.875077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd6cc-468f-41ca-8e88-7d634e5c0ee2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:43.892828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 224/465] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:43.894355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aec8df-ca94-4580-8d5d-ee8e1e069fbb None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.894636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aec8df-ca94-4580-8d5d-ee8e1e069fbb None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.894908 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aec8df-ca94-4580-8d5d-ee8e1e069fbb None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.900376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 225/466] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:43.900376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aec8df-ca94-4580-8d5d-ee8e1e069fbb None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:43.940737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a083e04-2e30-4e81-869e-6faba863fa45 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:43.972908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:43.973598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:43.973879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:43.974160 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:43.974872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:43.976304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:43.994915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aec8df-ca94-4580-8d5d-ee8e1e069fbb None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:44.004947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 242/467] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:43 2022] POST /identity/v3/users => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:44.004947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:44.044494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8b73d-5abc-46af-9541-3b4e714e1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:44.045696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b73d-5abc-46af-9541-3b4e714e1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.046108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b73d-5abc-46af-9541-3b4e714e1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.046487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b73d-5abc-46af-9541-3b4e714e1ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.059056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8b73d-5abc-46af-9541-3b4e714e1ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:44.060809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8b73d-5abc-46af-9541-3b4e714e1ab0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-85b8b73d-5abc-46af-9541-3b4e714e1ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:44.079197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:44.080162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:44.081296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:44.081296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:44.081296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:44.081296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:44.081296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 226/468] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:44.082728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f8867-e579-49ae-8194-94444398e94d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.083092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f8867-e579-49ae-8194-94444398e94d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.083444 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f8867-e579-49ae-8194-94444398e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.104749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-010f8867-e579-49ae-8194-94444398e94d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:44.104749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-010f8867-e579-49ae-8194-94444398e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:44.141109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785192a-975b-4491-8e33-f1b0c05ef853 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:44.178367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:44.179363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.179748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.180143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.181013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:44.182565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:44.184020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 227/469] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:44.185001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f8867-e579-49ae-8194-94444398e94d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:44.225336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 243/470] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:43 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:44.226319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:44.296841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f8867-e579-49ae-8194-94444398e94d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:44.345426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:44.346033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.346337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.346743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.347864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:44.348292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:44.350055 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:44.356258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bb016-a798-4bb3-915f-95122f702970 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:44.365815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 228/471] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:44.373157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:44.402875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:44.404334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.405134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.406209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.423844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:44.426173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:44.450729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:44.451958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:44.453307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:44.453307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:44.453307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:44.453307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:44.453307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 244/472] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:44.462047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:44.504334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3be1-7e1f-40bb-8b49-58988bccc250 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:44.541145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:44.541875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.542165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.542440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.543384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:44.544596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:44.569578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 229/473] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:44 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:44.602288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acf5a3-2eec-4dab-bcac-4a95f1f0b06f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:44.650891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bc9eb-83bf-4486-bf44-542f871015ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:44.651588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc9eb-83bf-4486-bf44-542f871015ec None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.651869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc9eb-83bf-4486-bf44-542f871015ec None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.652144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc9eb-83bf-4486-bf44-542f871015ec None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.652932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc9eb-83bf-4486-bf44-542f871015ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:44.653240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc9eb-83bf-4486-bf44-542f871015ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:44.654697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc9eb-83bf-4486-bf44-542f871015ec None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:44.674653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 245/474] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:44.680950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:44.805058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35354-ab93-4494-931a-10c397e1186d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:44.837983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695dc4f-2e21-4aff-b1ac-5c408fc029f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:44.838682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695dc4f-2e21-4aff-b1ac-5c408fc029f5 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.838975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695dc4f-2e21-4aff-b1ac-5c408fc029f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.839305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695dc4f-2e21-4aff-b1ac-5c408fc029f5 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.840007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695dc4f-2e21-4aff-b1ac-5c408fc029f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:44.841890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695dc4f-2e21-4aff-b1ac-5c408fc029f5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:44.865292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 230/475] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:44 2022] POST /identity/v3/users => generated 249 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:44.879221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910c8c-ad69-4d36-8e2d-0f8c01b06234 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.879513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910c8c-ad69-4d36-8e2d-0f8c01b06234 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.879787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910c8c-ad69-4d36-8e2d-0f8c01b06234 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.881438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 246/476] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:44.887604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c86ca-346a-4678-852a-0837714068a7 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:44.887897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c86ca-346a-4678-852a-0837714068a7 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:44.888179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c86ca-346a-4678-852a-0837714068a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:44.905651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-de6c86ca-346a-4678-852a-0837714068a7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:44.906901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-de6c86ca-346a-4678-852a-0837714068a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:44.979222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 231/477] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:45.003452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910c8c-ad69-4d36-8e2d-0f8c01b06234 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:45.121584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910c8c-ad69-4d36-8e2d-0f8c01b06234 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:45.160837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:45.161526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:45.161804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:45.162076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:45.162834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:45.164204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:45.172497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.sql.core [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 18:44:45.172497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 18:44:45.172497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [parameters: {'id': 'ed859e0619c94360aab0a09a2f17c4e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 18:44:45.172497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79971) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application result = self._query(query) May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application conn.query(q) May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application result.read() May 10 18:44:45.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return ref.to_dict() May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 18:44:45.190783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application next(self.gen) May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application yield resource May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application next(self.gen) May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self.session.rollback() May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self.force_reraise() May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise self.value May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application session.commit() May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 18:44:45.191723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._prepare_impl() May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self.session.flush() May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._flush(objects) May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application compat.raise_( May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application flush_context.execute() May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rec.execute(self) May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 18:44:45.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 18:44:45.194433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application result = self._query(query) May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application conn.query(q) May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application result.read() May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 18:44:45.195578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [parameters: {'id': 'ed859e0619c94360aab0a09a2f17c4e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:45.196568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 18:44:45.197716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:45.208000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 247/478] 10.222.0.52 () {60 vars in 1131 bytes} [Tue May 10 18:44:45 2022] POST /identity/v3/roles => generated 144 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:45.208070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c86ca-346a-4678-852a-0837714068a7 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:45.307874 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c86ca-346a-4678-852a-0837714068a7 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:45.342593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af4079-dacc-4b58-95cb-64e1a42ce331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:45.343439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4079-dacc-4b58-95cb-64e1a42ce331 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:45.343724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4079-dacc-4b58-95cb-64e1a42ce331 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:45.344001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4079-dacc-4b58-95cb-64e1a42ce331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:45.354765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af4079-dacc-4b58-95cb-64e1a42ce331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-53af4079-dacc-4b58-95cb-64e1a42ce331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:45.362960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:45.363828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:45.364613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 232/479] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:44:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:45.370196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:45.490397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17999-f7f4-4eab-a86e-70dc37f9a13c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:45.538642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae5577-1c1d-4076-abcf-1737ee35ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:45.539356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5577-1c1d-4076-abcf-1737ee35ac3d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:45.539640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5577-1c1d-4076-abcf-1737ee35ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:45.539919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5577-1c1d-4076-abcf-1737ee35ac3d None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:45.540748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5577-1c1d-4076-abcf-1737ee35ac3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:45.541066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5577-1c1d-4076-abcf-1737ee35ac3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:45.542517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5577-1c1d-4076-abcf-1737ee35ac3d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:45.555822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 248/480] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:46.696920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaaeeb-4737-43d1-ad4d-6c41c47dbc69 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:46.697464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaaeeb-4737-43d1-ad4d-6c41c47dbc69 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:46.697464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaaeeb-4737-43d1-ad4d-6c41c47dbc69 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:46.699084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 233/481] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:46.704987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266c11-9afe-48fb-ba29-7c555ebf05ca None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:46.705402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266c11-9afe-48fb-ba29-7c555ebf05ca None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:46.705488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266c11-9afe-48fb-ba29-7c555ebf05ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:46.737699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-89266c11-9afe-48fb-ba29-7c555ebf05ca None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:46.738909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-89266c11-9afe-48fb-ba29-7c555ebf05ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:46.828048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 249/482] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:46.863308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaaeeb-4737-43d1-ad4d-6c41c47dbc69 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:46.994703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaaeeb-4737-43d1-ad4d-6c41c47dbc69 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.036357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fccf81-0cf8-47f8-bd93-b141018255bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.037218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fccf81-0cf8-47f8-bd93-b141018255bd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.037553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fccf81-0cf8-47f8-bd93-b141018255bd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.037833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fccf81-0cf8-47f8-bd93-b141018255bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.054002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fccf81-0cf8-47f8-bd93-b141018255bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-82fccf81-0cf8-47f8-bd93-b141018255bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:47.062030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:47.062910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:47.063786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 234/483] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:47.071016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266c11-9afe-48fb-ba29-7c555ebf05ca None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.222342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266c11-9afe-48fb-ba29-7c555ebf05ca None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.236502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab66a8-47f3-49bb-b242-8a6ddff83dbc None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.236857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab66a8-47f3-49bb-b242-8a6ddff83dbc None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.237125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab66a8-47f3-49bb-b242-8a6ddff83dbc None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.238766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 235/484] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:47.250566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7d91-5ec0-4910-b279-e8d65de89b23 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.250726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7d91-5ec0-4910-b279-e8d65de89b23 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.251023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7d91-5ec0-4910-b279-e8d65de89b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.259328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a1562-e252-41c3-a652-2414294a646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.260259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a1562-e252-41c3-a652-2414294a646b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.261147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a1562-e252-41c3-a652-2414294a646b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.261608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a1562-e252-41c3-a652-2414294a646b None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.262721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a1562-e252-41c3-a652-2414294a646b None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:47.263224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a1562-e252-41c3-a652-2414294a646b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:47.264841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a1562-e252-41c3-a652-2414294a646b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:47.273567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 250/485] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:47.279331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a1562-e252-41c3-a652-2414294a646b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.285687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-954a7d91-5ec0-4910-b279-e8d65de89b23 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:47.286894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-954a7d91-5ec0-4910-b279-e8d65de89b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:47.377297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a1562-e252-41c3-a652-2414294a646b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.413442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.414603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.415055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.415495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.416016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 236/486] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:47.417537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510d67-f9a6-4299-84a1-365e68dbba69 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.417892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510d67-f9a6-4299-84a1-365e68dbba69 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.418245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510d67-f9a6-4299-84a1-365e68dbba69 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.423683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 237/487] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:47.425581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d547-342a-4df1-885a-d5299cafe610 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.426998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d547-342a-4df1-885a-d5299cafe610 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.427772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d547-342a-4df1-885a-d5299cafe610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.432803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:47.434293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:47.453276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b467d547-342a-4df1-885a-d5299cafe610 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:47.454682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b467d547-342a-4df1-885a-d5299cafe610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:47.461885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:47.462771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:47.464070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:47.464070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:47.464070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:47.464070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:47.464070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 251/488] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:47.464460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.540777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 238/489] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:47.540777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467d547-342a-4df1-885a-d5299cafe610 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.599578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364a634-9bac-4321-a2e9-7b21d8252a51 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.628982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467d547-342a-4df1-885a-d5299cafe610 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.633828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.634881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.635723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.636193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.646760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:47.654746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:47.655630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:47.656449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:47.663606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 252/490] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:47.663606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.667437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.668089 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.668374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.668647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.669426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:47.669807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:47.671212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:47.683676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 239/491] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:47.684382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.765709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cbe12-8acc-4abb-a4ae-1a45789d1afc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.787934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da08c92-f4f6-46f7-8806-b0a4710ce366 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.805301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.806446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.806942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.807413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.822335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.823113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.823494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.823845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:47.824532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:47.824886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:47.825107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:47.826335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:47.833674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:47.834586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:47.835404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:47.842109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 240/492] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:47.842109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.842764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 253/493] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:47.843798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:47.949706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404c897-bc4b-4dc9-9374-94f8ff68825b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.967666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5da4-08de-497a-90b0-e863eabd2ab5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:47.994735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:47.995932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:47.996282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:47.996636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.006592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.007782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.008249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.008773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.010932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.012614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.018307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.020062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:48.031920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:48.033121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:48.034277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:48.034277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:48.034277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:48.034277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:48.034277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 254/494] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:48.034277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:48.039696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:48.040581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:44:48.041774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:48.044245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 241/495] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:44:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:48.045400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.151604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddfd59-49fb-4529-81aa-06323f0fa760 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.162076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa0f1-d44e-4dd3-b8b2-6bebbf860d0d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.186762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.187572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.187858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.188134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.188897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:48.189204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.190590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.196704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba521b1-7ca6-44bd-9912-bd7146b46b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.197383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba521b1-7ca6-44bd-9912-bd7146b46b32 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.197667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba521b1-7ca6-44bd-9912-bd7146b46b32 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.197947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba521b1-7ca6-44bd-9912-bd7146b46b32 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.198705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba521b1-7ca6-44bd-9912-bd7146b46b32 None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:48.199020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba521b1-7ca6-44bd-9912-bd7146b46b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.200383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba521b1-7ca6-44bd-9912-bd7146b46b32 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.204716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 242/496] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:48.204716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.211312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 255/497] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:48.212620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576133a3-4324-44ac-9cd8-d2c0249333fb None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.212939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576133a3-4324-44ac-9cd8-d2c0249333fb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.213224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576133a3-4324-44ac-9cd8-d2c0249333fb None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.214649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 256/498] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:48.215173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576133a3-4324-44ac-9cd8-d2c0249333fb None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.315946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a658-c55a-47cb-9d2d-96eddef1116f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.316436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576133a3-4324-44ac-9cd8-d2c0249333fb None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.348318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.349020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.349299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.349398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b714b57-cb5b-438d-b795-2015c13aee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.349602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.350144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714b57-cb5b-438d-b795-2015c13aee52 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.350407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:48.350501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714b57-cb5b-438d-b795-2015c13aee52 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.350686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714b57-cb5b-438d-b795-2015c13aee52 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.350778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.352133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.358884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b714b57-cb5b-438d-b795-2015c13aee52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.360330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b714b57-cb5b-438d-b795-2015c13aee52 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-4b714b57-cb5b-438d-b795-2015c13aee52 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:48.375675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:48.376625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:48.377608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 257/499] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:48.378688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d69c1-7a42-4bf4-ad9b-19ba0a22da43 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.378857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d69c1-7a42-4bf4-ad9b-19ba0a22da43 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.379119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d69c1-7a42-4bf4-ad9b-19ba0a22da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.392573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 243/500] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:48.393803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.398071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3c0d69c1-7a42-4bf4-ad9b-19ba0a22da43 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:48.399376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3c0d69c1-7a42-4bf4-ad9b-19ba0a22da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:48.464409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 258/501] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:48.465553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d69c1-7a42-4bf4-ad9b-19ba0a22da43 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.495432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21ee92-e125-4e8e-9962-a93f0a93c528 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.527955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.528784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.529065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.529319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.539065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.540516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:48.557892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:48.558819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:48.559740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:48.559740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:48.559740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:48.559740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:48.559947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d69c1-7a42-4bf4-ad9b-19ba0a22da43 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.560031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 244/502] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:48.560031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.594519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05ffca-dd5c-4af1-88d7-d474251b4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.595198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ffca-dd5c-4af1-88d7-d474251b4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.595480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ffca-dd5c-4af1-88d7-d474251b4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.595752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ffca-dd5c-4af1-88d7-d474251b4ea7 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.596603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ffca-dd5c-4af1-88d7-d474251b4ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:48.596980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ffca-dd5c-4af1-88d7-d474251b4ea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.598482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ffca-dd5c-4af1-88d7-d474251b4ea7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.634322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 259/503] 10.222.0.52 () {56 vars in 1137 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:48.636142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fcb47-f20f-42d2-a2c6-52900543ae9b None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.636530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fcb47-f20f-42d2-a2c6-52900543ae9b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.636937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fcb47-f20f-42d2-a2c6-52900543ae9b None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.639584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 260/504] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:48.639584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fcb47-f20f-42d2-a2c6-52900543ae9b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.660482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa65362-2d78-448c-8f83-14d6ad2ee96b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.693856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.694516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.694771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.695049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.734823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fcb47-f20f-42d2-a2c6-52900543ae9b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.760182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.762059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.769623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.770431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.770712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.770984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.781174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:48.788753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:48.789805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:48.790737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:48.792824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 261/505] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:48.793811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.861003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 245/506] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:48.861836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:48.889919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c39e2b-ae5c-4b4a-b49a-ff687f671584 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.921598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a653f1-b47c-44ce-b63b-28a226eec761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.922356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a653f1-b47c-44ce-b63b-28a226eec761 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.922644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a653f1-b47c-44ce-b63b-28a226eec761 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.922925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a653f1-b47c-44ce-b63b-28a226eec761 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.923721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a653f1-b47c-44ce-b63b-28a226eec761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:48.924037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a653f1-b47c-44ce-b63b-28a226eec761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:48.925467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a653f1-b47c-44ce-b63b-28a226eec761 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:48.936939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 262/507] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:48.938115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca6fd-b620-45df-a09d-8fb669fd6e97 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.938397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca6fd-b620-45df-a09d-8fb669fd6e97 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.938674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca6fd-b620-45df-a09d-8fb669fd6e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:48.954065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981200-7218-4213-a0cc-156f9c03b6dc None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:48.955381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-971ca6fd-b620-45df-a09d-8fb669fd6e97 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:48.956567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-971ca6fd-b620-45df-a09d-8fb669fd6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:48.986139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:48.987008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:48.987288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:48.987560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.018654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 263/508] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:49.019461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca6fd-b620-45df-a09d-8fb669fd6e97 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.051310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.052970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.111619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca6fd-b620-45df-a09d-8fb669fd6e97 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.144981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.145645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.145933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.146207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.146957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:49.147260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.148608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 246/509] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:49.148770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.149476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.156563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 264/510] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:49.157323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.245545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279aae-0ee0-45b6-b1e9-12d558f3617b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.253876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b2cb0-37ea-4d07-84e6-43332a015126 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.279330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.280210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.280561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.280882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.285751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.286536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.286815 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.287079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.290679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.292121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.294271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.295767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:49.309287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:49.310295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:44:49.311236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:49.311727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:49.312451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:49.313313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:49.313313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:49.313313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.313313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:49.313515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 265/511] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:49.313586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 247/512] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:49.313650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.313713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.410140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c0d80-7a3f-48c6-be50-b29c1ae00ab6 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.412571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e5db-8132-439a-8070-0b449ee61060 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.447571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.448402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.448705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.448977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.452329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.453162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.453444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.453719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.460446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.461939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.464433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.465921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:49.479126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:49.479980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:49.480858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:49.480858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:49.480858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.480858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:49.480858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 248/513] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:49.481137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:49.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:49.483608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:49.484439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:49.484439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:49.484439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.484439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:49.484439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 266/514] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:49.484835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.577755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3a732-458f-4119-a0bf-425018721dd7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.582959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4dd1b-515e-4099-bfbe-8d9f3d17b922 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.611459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.612279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.612551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.612864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.615542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.616199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.616479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.616796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.617525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:49.617836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.619216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.623104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.624539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.631462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 267/515] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:49.632238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:49.642250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:49.643278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:49.644642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:49.644642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:49.644642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:49.644642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:49.644642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 249/516] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:49.644642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.729893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350f37d-f209-42a8-8b5f-1fdd22b36db5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.740427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6ff91-e3ca-4138-9a59-bc922fe55e36 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.763705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.764381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.764667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.764971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.765805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:49.766116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.767566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.773613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.774253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.774529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.774801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.775514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:49.775814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.777187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.784049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 268/517] 10.222.0.52 () {56 vars in 1137 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:49.784854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.788313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 250/518] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:49.789119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.882857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a88d05-a368-41a1-824b-7bcb09597fff None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.886787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3c1e-cbde-4230-bd3d-7b426283af40 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:49.915774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.916569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.916875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.917192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.920142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:49.920831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:49.921113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:49.921389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:49.922115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:49.922427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.923728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:49.923820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.925198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:49.934804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 269/519] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:49.935536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:49.940018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:49.940917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:49.941750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 251/520] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:49.942221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.029155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e9ac-bca6-4e59-afd2-9c3116461eee None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.041593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e3d34-9887-441f-8903-e17a341069b8 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.060470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.061162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.061447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.061723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.062449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:50.062756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.064120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.075149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.075277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 270/521] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:50.075804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.076117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.076222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.076508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.139321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.140752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.169764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de288c1f-3842-4481-8673-9e34615f857c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.203286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.204063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.204354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.204607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.211212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.212646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:50.226596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:50.227439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:50.228286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 271/522] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:50.228781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.236105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 252/523] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:50.236972 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.327633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f094-22c5-4a05-b9c8-17045ca72c52 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.328052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29cb3-8623-4714-8897-25e42224f744 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.361167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.361341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.361826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.361929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.362106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.362203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.362380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.362488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.363152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.363247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:50.363468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.364588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.364909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.382863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 253/524] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:50.383674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.404805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 272/525] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:44:50 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:44:50.404805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.499002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462be3-af0f-4284-b1de-e87a7790fbd9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.501650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d443-1906-4517-bc69-defdf2590079 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.537065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.537877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.538161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.538439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.540793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.541500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.541773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.542051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.542871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:50.543191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.544757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.546980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.548460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.572598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 273/526] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:50.572820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:50.573719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 18:44:50.574593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:50.575097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.575172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 254/527] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:50.575172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.676369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee58d-551c-4416-b8e5-86c5fd27a36c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.680799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e600a9-c856-402f-85d0-adb69be41b12 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.709999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.710803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.711106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.711472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.713224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.714080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.714182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.714412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.715245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=dff69f29cd4341f488887fea0dd2e540) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:50.715557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.717068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.721189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.729069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 255/528] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/role_assignments?user.id=dff69f29cd4341f488887fea0dd2e540&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:50.729251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.729330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:50.748517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:50.749483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:50.750340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:50.750340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:50.750340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:50.750340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:50.750340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 274/529] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:50.751069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.840739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dca8e-651e-4334-966a-fea4180ca178 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.857389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5d9b-30a9-4d38-b0ae-0a422977ac5a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:50.881591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.882305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.882591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.882871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.883735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:50.884050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.885915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.894614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:50.895290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:50.895568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:50.895837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:50.896706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=8650bbea186e427fac890eabe18ba153) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:50.897074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:50.898580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:50.904933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 275/530] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/role_assignments?user.id=8650bbea186e427fac890eabe18ba153&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:50.905677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 256/531] 10.222.0.52 () {56 vars in 1139 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:50.905931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:50.916725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:51.023652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51b622-eff2-4111-a785-aeee12da7c01 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.030721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d531ec-e6d5-43b2-945a-5c67eb7111cc None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.059009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.064723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.064723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.064723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.064723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:51.064723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.064723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.074716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.075389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.075679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.080712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.080916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 276/532] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:51.081544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:51.155178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.156727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.217667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd1f2-2b43-4131-99fb-13cbac552f3b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.276839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 257/533] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:51.278967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.279790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.280067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.280332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.281916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:51.298063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.299337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:51.326099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:51.327085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:51.327918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:51.330478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 277/534] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:51.331710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:51.434651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53577eec-e382-46e7-9786-642e8ef74a28 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.478583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85d62-0782-4e01-91a2-716ed3e1f705 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.490764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.491838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.492283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.492742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.511266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.513455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.513823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.514495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.514773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.515042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.515837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:51.516142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.517732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.534762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 278/535] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:51.535906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:51.536776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:51.537639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:51.537639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:51.537639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:51.537639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:51.537928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:51.545574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 258/536] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:51.550686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:51.634788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4fca6-cc27-48f3-b9f9-45435e97fe15 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.661841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a45771-0e32-4611-bb83-7152814180fd None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.669640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.670601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.670886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.671161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.672002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=b8cb476654be463e9d7d19d92576e495) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:51.672303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.673751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.684823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 279/537] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:51 2022] GET /identity/v3/role_assignments?user.id=b8cb476654be463e9d7d19d92576e495&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:51.708300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.709045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.709377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.709659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.710421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:51.710733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.712171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.732422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 259/538] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:51.737721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:51.881513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ad778-0af1-4742-9b54-b603b58afd9f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:51.919769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:51.920694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:51.920982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:51.921252 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:51.928875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:51.930344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:51.944984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:51.947047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:51.949117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 280/539] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:51.961969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:52.084719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ee153-3640-4c63-b7ad-8eaff3c757b2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:52.122987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453c7d3-12b4-45ac-a9cc-98451a1406d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:52.123675 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453c7d3-12b4-45ac-a9cc-98451a1406d6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:52.123957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453c7d3-12b4-45ac-a9cc-98451a1406d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:52.124234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453c7d3-12b4-45ac-a9cc-98451a1406d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:52.125073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453c7d3-12b4-45ac-a9cc-98451a1406d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:52.125389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453c7d3-12b4-45ac-a9cc-98451a1406d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:52.126844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453c7d3-12b4-45ac-a9cc-98451a1406d6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:52.140650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 260/540] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:52.146234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:52.271343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d77d-fd71-46d6-81d1-779a2596c976 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:52.312334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4361191-ee71-4d1f-9eef-26eaa561d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:52.313029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4361191-ee71-4d1f-9eef-26eaa561d723 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:52.313307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4361191-ee71-4d1f-9eef-26eaa561d723 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:52.313575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4361191-ee71-4d1f-9eef-26eaa561d723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:52.314417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4361191-ee71-4d1f-9eef-26eaa561d723 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=945283f83c1b4ee0a1a59b0732090fbf) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:52.314724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4361191-ee71-4d1f-9eef-26eaa561d723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:52.316161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4361191-ee71-4d1f-9eef-26eaa561d723 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:52.322867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 281/541] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:52 2022] GET /identity/v3/role_assignments?user.id=945283f83c1b4ee0a1a59b0732090fbf&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:52.867878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538dc4f-b727-4dd4-818b-6243e505ada1 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:52.868272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538dc4f-b727-4dd4-818b-6243e505ada1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:52.868440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538dc4f-b727-4dd4-818b-6243e505ada1 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:52.870111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 261/542] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:52.875293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836dd1a-5f51-41ef-b00d-748792d84cb5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:52.875580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836dd1a-5f51-41ef-b00d-748792d84cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:52.875856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836dd1a-5f51-41ef-b00d-748792d84cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:52.902417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e836dd1a-5f51-41ef-b00d-748792d84cb5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:52.903922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e836dd1a-5f51-41ef-b00d-748792d84cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:52.997770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 282/543] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:53.033277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538dc4f-b727-4dd4-818b-6243e505ada1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:53.189557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538dc4f-b727-4dd4-818b-6243e505ada1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:53.243573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06b3e-4e5d-483b-a94d-a1631a1c86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:53.244746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06b3e-4e5d-483b-a94d-a1631a1c86d6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.245031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06b3e-4e5d-483b-a94d-a1631a1c86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.245305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06b3e-4e5d-483b-a94d-a1631a1c86d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.264997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06b3e-4e5d-483b-a94d-a1631a1c86d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-60b06b3e-4e5d-483b-a94d-a1631a1c86d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:53.277402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:53.279919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:53.281891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 262/544] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:53.289961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836dd1a-5f51-41ef-b00d-748792d84cb5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:53.438352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836dd1a-5f51-41ef-b00d-748792d84cb5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:53.482823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0272cd-97db-49d1-a653-42a3c556fa8e None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.483173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0272cd-97db-49d1-a653-42a3c556fa8e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.483434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0272cd-97db-49d1-a653-42a3c556fa8e None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.485027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 263/545] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:53.488612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:53.489328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.489613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.489893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.490530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e79ba-ed49-4906-8f12-18a286da4ce1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.490708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:53.490969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:53.491078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e79ba-ed49-4906-8f12-18a286da4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.491494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e79ba-ed49-4906-8f12-18a286da4ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.492346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:53.506932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 283/546] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:53.512823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:53.517759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1d1e79ba-ed49-4906-8f12-18a286da4ce1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:53.522603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1d1e79ba-ed49-4906-8f12-18a286da4ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:53.632944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 264/547] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:53.634454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05766-7e36-47c8-9310-57f178f714da None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.634744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05766-7e36-47c8-9310-57f178f714da None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.635147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05766-7e36-47c8-9310-57f178f714da None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.637618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 265/548] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:53.646141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca12c09-da9e-4228-bd70-05c7c13d9ea3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:53.654483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a520-2444-4ff4-b9d3-432d4dbbd475 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.654760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a520-2444-4ff4-b9d3-432d4dbbd475 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.655046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a520-2444-4ff4-b9d3-432d4dbbd475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.677326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-e591a520-2444-4ff4-b9d3-432d4dbbd475 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:53.678535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e591a520-2444-4ff4-b9d3-432d4dbbd475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:53.686180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:53.686995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.687272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.687538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.702585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:53.705502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:53.726666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:53.727587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:53.728513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:53.728513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:53.728513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:53.728513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:53.728513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 284/549] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:53.735133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:53.776694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 266/550] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:44:53.776694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a520-2444-4ff4-b9d3-432d4dbbd475 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:53.876840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96168be0-7464-4baf-9a68-8e74cc944618 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:53.911555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a520-2444-4ff4-b9d3-432d4dbbd475 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:53.913469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:53.914368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.914708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.915046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.926082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:53.934781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:53.936057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:53.937131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:53.941190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 285/551] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:53.942127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:53.959605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:53.960875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:53.961413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:53.962029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:53.963838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:53.964720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:53.967750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:53.989183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 267/552] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:53.991209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.055121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2a89f-a30c-4a36-aed1-f0ce2d4c520e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.090810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.091644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.091931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.092256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.103543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:54.111684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:54.112580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:54.113413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:54.116794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 286/553] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:54.117649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.119742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284d306-48d6-4947-9bfd-2b9a7926a13f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.162841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.164255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.165091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.165572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.166717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:54.167168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.169277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.180308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 268/554] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:54.181407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.227811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aecfc1-f482-455c-8358-a6a624602c55 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.264478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.265343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.265624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.265899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.277157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.279426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.296495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8395a-7a3e-443b-9f9a-5d4fb20e0c91 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:54.297675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:54.298534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 18:44:54.299625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:54.307571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 287/555] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:54.308648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.334927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.336096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.336214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.336591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.337510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:54.337917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.339385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.352838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 269/556] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:54.353866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.430691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcadac1-d6ac-4026-8fed-ffe946ecb614 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.457860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d697e-43ec-4a59-81ee-5ca2afdf4b05 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.471365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.472266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.472660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.473095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.485788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.487363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.501284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.502234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.502655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.503093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.504104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:54.504580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.506231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:54.508391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:54.509462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:54.510960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:54.510960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:54.510960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:54.510960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:54.516805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 288/557] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:54.517881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.531588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 270/558] 10.222.0.52 () {56 vars in 1135 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:54.532663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.632795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63693-dbab-4d4c-95cc-b093b23796ce None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.646255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ab1d4-d783-4682-9483-4bb6bb10a1dd None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.675151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fabc73-bb08-427a-b2ea-2cc7c9642c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.675973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fabc73-bb08-427a-b2ea-2cc7c9642c02 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.676253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fabc73-bb08-427a-b2ea-2cc7c9642c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.676529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fabc73-bb08-427a-b2ea-2cc7c9642c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.681037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.681715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.681990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.682260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.683407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:54.683721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.685590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.688121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fabc73-bb08-427a-b2ea-2cc7c9642c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.689992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fabc73-bb08-427a-b2ea-2cc7c9642c02 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.698173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 271/559] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:54.698853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-36fabc73-bb08-427a-b2ea-2cc7c9642c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:54.713188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:54.714096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:54.714933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:54.714933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:54.714933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:54.714933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:54.714933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 289/560] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:54.715943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311747-61d7-40c3-9586-9ab747ab6e3e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.716045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311747-61d7-40c3-9586-9ab747ab6e3e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.716435 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311747-61d7-40c3-9586-9ab747ab6e3e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.720929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 290/561] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:54.720929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311747-61d7-40c3-9586-9ab747ab6e3e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.802592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf82a5-47ba-435b-8bfd-f73b7e078135 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.818479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311747-61d7-40c3-9586-9ab747ab6e3e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:54.834722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8e18d-2aa7-4350-ac1f-e3c8b1f97092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.835376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e18d-2aa7-4350-ac1f-e3c8b1f97092 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.835658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e18d-2aa7-4350-ac1f-e3c8b1f97092 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.835933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e18d-2aa7-4350-ac1f-e3c8b1f97092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.851056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:54.851863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:54.852144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:54.852412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:54.860257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.861894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:54.875933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:54.877079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 291/562] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:54.878508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:54.913725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8e18d-2aa7-4350-ac1f-e3c8b1f97092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:54.915252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8e18d-2aa7-4350-ac1f-e3c8b1f97092 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:54.984210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df8b4-0984-405f-9053-ef1958d9edb0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.011104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 272/563] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:44:55.012407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ee6d-5955-4860-b0e8-924ef399bc52 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.012711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ee6d-5955-4860-b0e8-924ef399bc52 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.012987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ee6d-5955-4860-b0e8-924ef399bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.025261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.025936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.026219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.026494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.027229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:55.027546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.028968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.030399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-17b4ee6d-5955-4860-b0e8-924ef399bc52 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:55.031741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-17b4ee6d-5955-4860-b0e8-924ef399bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:55.041203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 292/564] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:55.042116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.101306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 273/565] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:55.102418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ee6d-5955-4860-b0e8-924ef399bc52 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.142669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f784ad-4b51-4359-8af1-a383f09b1936 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.173912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.174588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.174871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.175143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.175984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:55.176294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.177747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.194436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 293/566] 10.222.0.52 () {56 vars in 1137 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:55.195233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.196543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ee6d-5955-4860-b0e8-924ef399bc52 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.230774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6c8f-43ad-4a57-ab1d-6001a6e19661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.231573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6c8f-43ad-4a57-ab1d-6001a6e19661 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.231853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6c8f-43ad-4a57-ab1d-6001a6e19661 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.232232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6c8f-43ad-4a57-ab1d-6001a6e19661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.241960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc6c8f-43ad-4a57-ab1d-6001a6e19661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.243392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc6c8f-43ad-4a57-ab1d-6001a6e19661 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-a0bc6c8f-43ad-4a57-ab1d-6001a6e19661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:55.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:55.261855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:55.262726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:55.262726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:55.262726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:55.262726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:55.262726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 274/567] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:55.263363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037deeb8-eaee-4586-a0fb-986ea344b5da None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.263363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037deeb8-eaee-4586-a0fb-986ea344b5da None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.263564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037deeb8-eaee-4586-a0fb-986ea344b5da None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.264840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 275/568] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:55.265536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037deeb8-eaee-4586-a0fb-986ea344b5da None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.293528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23858643-b28c-425d-b714-936d64ea6f51 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.326109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.326894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.327174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.327439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.334201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.335631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:55.349356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:55.350288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 294/569] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:55.351354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.367301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037deeb8-eaee-4586-a0fb-986ea344b5da None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.400684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df8eb-f24e-4fee-9fbc-5c5f67f46664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.401539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df8eb-f24e-4fee-9fbc-5c5f67f46664 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.401842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df8eb-f24e-4fee-9fbc-5c5f67f46664 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.402119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df8eb-f24e-4fee-9fbc-5c5f67f46664 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.412052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df8eb-f24e-4fee-9fbc-5c5f67f46664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4b4df8eb-f24e-4fee-9fbc-5c5f67f46664 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:55.419789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:55.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:55.421554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 276/570] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:55.422942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9ea93-1684-4836-b170-acc6a1206378 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.422942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9ea93-1684-4836-b170-acc6a1206378 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.422942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9ea93-1684-4836-b170-acc6a1206378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.438854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-39a9ea93-1684-4836-b170-acc6a1206378 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:55.440031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-39a9ea93-1684-4836-b170-acc6a1206378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:55.450988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92237-0777-4462-aeed-b8538a18e9a3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.485479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034080-785c-4a17-9527-88179326aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.486282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034080-785c-4a17-9527-88179326aa96 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.486613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034080-785c-4a17-9527-88179326aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.486874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034080-785c-4a17-9527-88179326aa96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.496976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73034080-785c-4a17-9527-88179326aa96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.498510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73034080-785c-4a17-9527-88179326aa96 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.508929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 277/571] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:55.509772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9ea93-1684-4836-b170-acc6a1206378 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-73034080-785c-4a17-9527-88179326aa96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:55.516145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:55.517063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:55.518498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:55.518498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:55.518498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:55.518498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:55.518498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 295/572] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:55.518498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034080-785c-4a17-9527-88179326aa96 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.617387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034080-785c-4a17-9527-88179326aa96 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.618177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9ea93-1684-4836-b170-acc6a1206378 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.652157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.652871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.653138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.653407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.653715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.654334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:55.654494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.654615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.654769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.655038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.655758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:55.656059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.656150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.657427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.668130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 278/573] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:55.668932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.673692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 296/574] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:55.674511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.763416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea60bab-2d39-4afe-bc9e-11803f196900 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.773028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703745-6366-408d-abdb-fbb975cb11e7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.797587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.798277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.798558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.798847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.799587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:55.799892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.801291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.804754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.805417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.805702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.805970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.806692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:55.806997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.808344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.808969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 279/575] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:55.809746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.823992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 297/576] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:55.823992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.906526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdf508-f962-4b03-afa6-d66006b5162f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.917421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee775-8bac-4c3c-aa0a-f37002a7c1ff None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:55.939434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.940229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.940509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.940810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.952296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:55.955508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:55.958686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:55.958972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:55.959244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:55.961984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:55.962934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:55.963786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 280/577] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:55.965064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:55.966764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:55.968220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:55.982903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:55.983834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 298/578] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:55.985806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.058614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb30b8c-9a16-40aa-af92-880249abc622 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.087581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abda8-2779-4fac-af63-3422a296c95e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.091027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.091847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.092122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.092393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.102731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.104170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.119916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.120703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:56.120803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:56.121661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:56.122714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:56.122714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:56.122714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:56.122714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:56.122946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.122946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.123069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 281/579] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:56.123069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.133376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.134824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:56.152259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:56.153309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:56.159106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:56.159106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:56.159106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:56.159106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:56.159106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 299/580] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:56.159106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.222438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cf28f-f9a0-468d-92ed-654a47149dd5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.253481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea163a-c4bf-4d16-b95c-d20ea0bdc3b5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.255490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.256286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.256567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.256894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.263810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.265293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:56.279186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:56.280209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:56.281276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 282/581] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:56.281775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.288814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.289495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.289775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.290047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.290799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:56.291105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.292457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.305264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 300/582] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:56.305264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.380111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241eea6-ac2c-4691-bc6b-29233519ac70 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.398662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83bf73-e232-40ca-90f9-7f78728c4154 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.413864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.414470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.414750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.415019 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.415807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:56.416115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.417574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.429048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 283/583] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:56.429871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.434135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.434811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.435165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.435441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.436180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:56.436487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.437895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.450706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 301/584] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:56.450706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.528835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72c3b8-be64-4c82-a733-06b2cd881cf4 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.550405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232ba87-362c-49c4-9c21-7810cee7db51 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.561733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.562402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.562682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.562952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.563679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:56.563984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.565386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.577113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 284/585] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:56.577698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.588689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.589381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.589649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.589925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.590723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:56.591035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.592552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.603670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 302/586] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:56.604442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.674894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea134-5165-40bd-88fe-cbe990364b26 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.697672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ae5c-eabd-43d2-8cd5-a0e9272faf83 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.710482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.711251 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.711536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.711842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.722532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.724606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.732487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.733285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.733638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.733924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.734760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=a9e110bec628462e8699b8681daf2d58) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:56.735078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.736497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.741853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 303/587] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/role_assignments?user.id=a9e110bec628462e8699b8681daf2d58&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:56.742276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:56.743140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:56.744021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:56.744021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:56.744021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:56.744021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:56.744240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.744310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 285/588] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:56.744376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.855460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6b5e9-5956-40e7-a582-3a01720bd190 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.858477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b1e21-65e6-4c61-880f-8adf5fd4780c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:56.893656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.894905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.895334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.895485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:56.895899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.896250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:56.896520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:56.896828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:56.904407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.904891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:56.906347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.906464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:56.921750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:56.922780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:56.929236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:56.929948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:56.930784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:44:56.931691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:56.932208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 304/589] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:56.932208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:56.932329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 286/590] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:56.932329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.021863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf2d6-f329-440a-9f28-bc3c79ea12ae None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.028752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2d236-ec81-47db-8de3-9e02e64eaf41 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.054122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.055028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.055307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.055580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/8650bbea186e427fac890eabe18ba153/roles/2ce8fc0880a947b3933dc0c970afe142` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.062895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.063575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.063860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.064135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.064894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:57.065204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.066575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.070631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=8650bbea186e427fac890eabe18ba153, role_id=2ce8fc0880a947b3933dc0c970afe142)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.072053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.078226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 287/591] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:57.079161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.096905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 305/592] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:56 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/8650bbea186e427fac890eabe18ba153/roles/2ce8fc0880a947b3933dc0c970afe142 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:57.096905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.182885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb67a0-bb0d-4258-8d5a-79e7b5397d6b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.211425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534e567-6191-48be-ba80-8d8f125e6fa4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.217554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.218257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.218538 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.218805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.219672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:57.219980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.221489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.242038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 288/593] 10.222.0.52 () {56 vars in 1137 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:57.243010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.257420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.258484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.258990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.259850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.261299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:57.262145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.264423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.283823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 306/594] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:57.283823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.389410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd32e59-d900-43dd-aa95-34e63706146a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.395585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0abdd-33ec-41cb-896e-8bd9f97dcac4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.431525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.432338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.432619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.434105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.435216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.436017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.436290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.436553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.448814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.452029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.452140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.452483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:44:57.469922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:57.470926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 18:44:57.471857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:57.472391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:57.473206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:57.474079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:57.474079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:57.474079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:57.474079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:57.474079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 307/595] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:57.476839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 289/596] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:57.477646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.478806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.577505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd9a49-1919-496d-9af0-44f11a818312 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.581369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360b05f-06e5-4a8f-b699-2a49084d9d5d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.609995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.610905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.611181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.611453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/dff69f29cd4341f488887fea0dd2e540/roles/2ce8fc0880a947b3933dc0c970afe142` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.616779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.617701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.618198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.618667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.619587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:57.620100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.621690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.626218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=dff69f29cd4341f488887fea0dd2e540, role_id=2ce8fc0880a947b3933dc0c970afe142)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.627634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.634408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 290/597] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:57.640213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.647123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 308/598] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:57 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/dff69f29cd4341f488887fea0dd2e540/roles/2ce8fc0880a947b3933dc0c970afe142 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:57.648103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.760782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab42b2-b64a-4d45-a321-c36fc23b2eca None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.785614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e002dd-e1d8-4ed4-9ba2-6d48f8be5bcf None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:57.796464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.797642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.798178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.798755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.799866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:57.800404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.802170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.823678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 291/599] 10.222.0.52 () {56 vars in 1139 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:57.825095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:57.826210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:57.826685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:57.827149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:57.829587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:57.835355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:57.837252 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:57.852497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:57.853714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:57.854616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:44:57.857383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 309/600] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:57.864352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:58.012200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a34c0d-7312-4bd7-b33a-642b5429be77 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:58.015718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55836c8b-ed52-4500-b6ec-6edd43b03656 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:58.048122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:58.049514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:58.050085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:58.050580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:58.051688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:58.052102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:58.052454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:58.052957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:58.053245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:58.053521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:58.054769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:58.064178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:58.066555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:58.069451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 310/601] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:58.075572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:44:58.084942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:58.085863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:58.086868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:44:58.086868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:44:58.086868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:44:58.086868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:58.091006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 292/602] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:58.092127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:58.189725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e1bf-1be2-4699-9bc6-11ca0ed76ca7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:58.223047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:58.223735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:58.224018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:58.224298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:58.225074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:58.225390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:58.226768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:58.243017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 293/603] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:58.244255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:58.330689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aaac5-a532-48f9-bf06-a31446958548 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:58.341539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd39e-5552-473e-a12a-50780ef84b84 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:58.375314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:58.376136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:58.376422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:58.376723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:58.383549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:58.385031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:44:58.399970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:58.400960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:44:58.401876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:58.405965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 294/604] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:44:58.407170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:58.409387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:58.410315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:58.410596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:58.410871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/b8cb476654be463e9d7d19d92576e495/roles/2ce8fc0880a947b3933dc0c970afe142` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:58.469652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=b8cb476654be463e9d7d19d92576e495, role_id=2ce8fc0880a947b3933dc0c970afe142)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:58.471136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:58.509482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8b595-5a2d-4846-8b05-9a8b7064e344 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:58.512026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 311/605] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:58 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/b8cb476654be463e9d7d19d92576e495/roles/2ce8fc0880a947b3933dc0c970afe142 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:44:58.573558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948a63f-238e-477f-8dba-20cfbb3d13e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:58.574664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a63f-238e-477f-8dba-20cfbb3d13e6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:58.575143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a63f-238e-477f-8dba-20cfbb3d13e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:58.575667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a63f-238e-477f-8dba-20cfbb3d13e6 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:58.576702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948a63f-238e-477f-8dba-20cfbb3d13e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:58.577215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948a63f-238e-477f-8dba-20cfbb3d13e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:58.578902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948a63f-238e-477f-8dba-20cfbb3d13e6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:58.592727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 295/606] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:44:58.598475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:58.734219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad20a59-eab2-4449-b019-86a252b81e13 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:58.768519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698eec0-bc80-47dd-8253-537076748d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:58.769476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698eec0-bc80-47dd-8253-537076748d24 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:58.769758 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698eec0-bc80-47dd-8253-537076748d24 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:58.770035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698eec0-bc80-47dd-8253-537076748d24 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/945283f83c1b4ee0a1a59b0732090fbf/roles/2ce8fc0880a947b3933dc0c970afe142` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:58.785826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698eec0-bc80-47dd-8253-537076748d24 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=945283f83c1b4ee0a1a59b0732090fbf, role_id=2ce8fc0880a947b3933dc0c970afe142)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:58.787272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698eec0-bc80-47dd-8253-537076748d24 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:58.804013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 312/607] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:44:58 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/945283f83c1b4ee0a1a59b0732090fbf/roles/2ce8fc0880a947b3933dc0c970afe142 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:44:59.227272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9e0c-e381-40a8-b076-0436f3722cc8 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:59.227272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9e0c-e381-40a8-b076-0436f3722cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:59.227272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9e0c-e381-40a8-b076-0436f3722cc8 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:59.228073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 296/608] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:44:59.234075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df18b0-511e-4fd1-9d88-0de1883bd583 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:59.234535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df18b0-511e-4fd1-9d88-0de1883bd583 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:59.234711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df18b0-511e-4fd1-9d88-0de1883bd583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:59.254294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e8df18b0-511e-4fd1-9d88-0de1883bd583 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:59.255499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e8df18b0-511e-4fd1-9d88-0de1883bd583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:59.341107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 313/609] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:44:59.378911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a9e0c-e381-40a8-b076-0436f3722cc8 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:59.488323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a9e0c-e381-40a8-b076-0436f3722cc8 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:59.522639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:59.523490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:59.523823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:59.524105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:59.542657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:44:59.551120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:44:59.552119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:44:59.553002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:44:59.555905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 297/610] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:44:59.565851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df18b0-511e-4fd1-9d88-0de1883bd583 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:59.719392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df18b0-511e-4fd1-9d88-0de1883bd583 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:44:59.771439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dfba2-bd0f-4ea0-acce-d1cb62047a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:44:59.772047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dfba2-bd0f-4ea0-acce-d1cb62047a4f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:59.772339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dfba2-bd0f-4ea0-acce-d1cb62047a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:59.772606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dfba2-bd0f-4ea0-acce-d1cb62047a4f None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:59.773405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dfba2-bd0f-4ea0-acce-d1cb62047a4f None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:44:59.773717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dfba2-bd0f-4ea0-acce-d1cb62047a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:44:59.775108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dfba2-bd0f-4ea0-acce-d1cb62047a4f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:44:59.787937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 314/611] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:44:59.794121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:44:59.852514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a60dc-6530-4fbf-b01a-8980958e897e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:59.852881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a60dc-6530-4fbf-b01a-8980958e897e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:59.853129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a60dc-6530-4fbf-b01a-8980958e897e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:59.854796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 315/612] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:44:59.866080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b732d8-2ffc-4c5d-ab3b-6dd859c13337 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:44:59.866360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b732d8-2ffc-4c5d-ab3b-6dd859c13337 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:44:59.866648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b732d8-2ffc-4c5d-ab3b-6dd859c13337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:44:59.902253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-f5b732d8-2ffc-4c5d-ab3b-6dd859c13337 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:44:59.903448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f5b732d8-2ffc-4c5d-ab3b-6dd859c13337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:44:59.956081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e615b0-134b-4bcb-98f4-33e558d7909b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.019322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.020137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.020417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.020708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.039773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 316/613] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:45:00.040645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:00.046572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:00.064775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:00.066864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:00.068909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:00.068909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:00.068909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:00.068909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:00.068909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 298/614] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:00.077819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b732d8-2ffc-4c5d-ab3b-6dd859c13337 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.086882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.188704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b469d-86e9-4cbe-b252-540e9327bfe9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.224619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b732d8-2ffc-4c5d-ab3b-6dd859c13337 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.242781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.243602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.243887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.244167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.264509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.265902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.266403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.266872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.268092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:00.268908 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:00.273692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:00.275544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:00.288228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:00.289292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:00.290192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:00.292772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 299/615] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:00.301736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 317/616] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:00.302176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.309998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.448575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d237bf-c47c-45e8-9e21-017f8d7d11ab None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.489336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a01399-6706-459e-af25-52c57a4428da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.490199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a01399-6706-459e-af25-52c57a4428da None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.490482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a01399-6706-459e-af25-52c57a4428da None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.490754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a01399-6706-459e-af25-52c57a4428da None admin] PATH_INFO: `/v3/users/swift` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.499693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a01399-6706-459e-af25-52c57a4428da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:00.501178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a01399-6706-459e-af25-52c57a4428da None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:00.505934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ecee9-9fce-4bc0-b0fd-452db1f5b98f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-64a01399-6706-459e-af25-52c57a4428da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:00.515442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:00.516395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:00.517377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 318/617] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:00.518481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212acc37-c254-44c7-a136-6af350a1220e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.518481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212acc37-c254-44c7-a136-6af350a1220e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.518780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212acc37-c254-44c7-a136-6af350a1220e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.524144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 319/618] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:00.524942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212acc37-c254-44c7-a136-6af350a1220e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.550196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba26e46-73ac-46fd-8aa7-9c11b1757c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.551235 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26e46-73ac-46fd-8aa7-9c11b1757c08 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.551533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26e46-73ac-46fd-8aa7-9c11b1757c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.551976 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26e46-73ac-46fd-8aa7-9c11b1757c08 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.553078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba26e46-73ac-46fd-8aa7-9c11b1757c08 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:00.553645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba26e46-73ac-46fd-8aa7-9c11b1757c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:00.555478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba26e46-73ac-46fd-8aa7-9c11b1757c08 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:00.565846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 300/619] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:00.569473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b114-b0f3-47e1-a513-9577f7cc4f84 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.569770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b114-b0f3-47e1-a513-9577f7cc4f84 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.570045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b114-b0f3-47e1-a513-9577f7cc4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.592465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-abc9b114-b0f3-47e1-a513-9577f7cc4f84 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:00.593860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-abc9b114-b0f3-47e1-a513-9577f7cc4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:00.628955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212acc37-c254-44c7-a136-6af350a1220e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.661812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.662521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.662808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.663084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.663933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:00.664243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:00.665716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:00.675774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 301/620] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:00.676712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9b114-b0f3-47e1-a513-9577f7cc4f84 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.694895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 320/621] 10.222.0.52 () {56 vars in 1135 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:00.701622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.800543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9b114-b0f3-47e1-a513-9577f7cc4f84 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.806073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49002-9179-4955-b368-41ec1d4bd27e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.839687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.840655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.841139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.841487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.844496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:00.845336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:00.845621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:00.845894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:00.852142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:00.853738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:00.857894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:00.859345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:00.872601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:00.874422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:00.876471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:00.876471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:00.876471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:00.876471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:00.884694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:00.886481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:00.887580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:00.887580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:00.887580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:00.887580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:00.887883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 321/622] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:00.887971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 302/623] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:00.888137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.888229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:00.984703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1253a-f350-4635-b0f4-b5c02219f847 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:00.985846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1824f-5a36-4663-be3b-9ca0e94050b3 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.019280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.020102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.020228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.020383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.020658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.021223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.021593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.021964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.022834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:01.023242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.024817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.033234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:01.038422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 303/624] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:01.039487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:01.046040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:01.047275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:01.048306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 322/625] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:01.049430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.143030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92389f44-3f65-4540-bd5f-b4061ab9bd0e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.152954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429443-3f96-45c0-acd4-e1f29c705e43 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.176384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.177335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.177616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.178048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.179105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:01.179691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.181562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.186152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.186968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.187268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.187557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.194858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.196299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.199837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 304/626] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:01.201166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:01.213622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:01.215650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:01.218038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:01.220727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 323/627] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:01.220727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.298515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124df733-79c4-4bca-b99c-4e61eec0cc5c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.318529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c032-c50f-41d3-9d60-cc89ea74623b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.333650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f74563-1e34-4387-bec2-09c2a4826185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.334333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74563-1e34-4387-bec2-09c2a4826185 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.334610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74563-1e34-4387-bec2-09c2a4826185 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.334878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74563-1e34-4387-bec2-09c2a4826185 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.335626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f74563-1e34-4387-bec2-09c2a4826185 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:01.335935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f74563-1e34-4387-bec2-09c2a4826185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.337336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f74563-1e34-4387-bec2-09c2a4826185 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.345230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 305/628] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:01.345230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16767-16e2-4799-861f-133bf935cb3c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.345230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16767-16e2-4799-861f-133bf935cb3c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.345230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16767-16e2-4799-861f-133bf935cb3c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.345230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 306/629] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:01.345230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16767-16e2-4799-861f-133bf935cb3c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.359153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.359961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.360245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.360513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.367607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.369077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:01.383236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:01.384201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:01.385516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 324/630] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:01.386284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.460277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16767-16e2-4799-861f-133bf935cb3c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.485189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b20b-7f93-4d8f-9290-643e17bd16d3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.491868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd0e2-f85f-40f6-aaca-7856ccb1a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.492539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd0e2-f85f-40f6-aaca-7856ccb1a279 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.492838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd0e2-f85f-40f6-aaca-7856ccb1a279 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.493112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd0e2-f85f-40f6-aaca-7856ccb1a279 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.493901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd0e2-f85f-40f6-aaca-7856ccb1a279 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:01.494212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd0e2-f85f-40f6-aaca-7856ccb1a279 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.495626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd0e2-f85f-40f6-aaca-7856ccb1a279 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.507350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 307/631] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:01.508561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378917-145e-4bd6-b6f1-0190bbaca579 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.508885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378917-145e-4bd6-b6f1-0190bbaca579 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.509163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378917-145e-4bd6-b6f1-0190bbaca579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.517861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.518658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.518939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.519208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.524935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-98378917-145e-4bd6-b6f1-0190bbaca579 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:01.526120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-98378917-145e-4bd6-b6f1-0190bbaca579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:01.528996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.530430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:01.547440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:01.548503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:01.549508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:01.549508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:01.549508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:01.549508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:01.549508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 325/632] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:01.549508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.594724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 308/633] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:01.596384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36770b-9e64-4f41-808c-c91e32140828 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.596702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36770b-9e64-4f41-808c-c91e32140828 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.597209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36770b-9e64-4f41-808c-c91e32140828 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.598295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 309/634] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:01.598927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36770b-9e64-4f41-808c-c91e32140828 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.652690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7f9a-ac94-4d40-b44b-736e275aa62a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.684239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.684989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.685268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.685542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.686382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:01.686695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.688129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.694778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36770b-9e64-4f41-808c-c91e32140828 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.705147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 326/635] 10.222.0.52 () {56 vars in 1137 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:01.705903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.733284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbebcb1-9a24-4ed7-8353-a82a2945f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.734178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebcb1-9a24-4ed7-8353-a82a2945f234 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.734451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebcb1-9a24-4ed7-8353-a82a2945f234 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.734718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebcb1-9a24-4ed7-8353-a82a2945f234 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/a9e110bec628462e8699b8681daf2d58/roles/2ce8fc0880a947b3933dc0c970afe142` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.749011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbebcb1-9a24-4ed7-8353-a82a2945f234 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=a9e110bec628462e8699b8681daf2d58, role_id=2ce8fc0880a947b3933dc0c970afe142)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.751171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbebcb1-9a24-4ed7-8353-a82a2945f234 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.767900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 310/636] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:45:01 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/a9e110bec628462e8699b8681daf2d58/roles/2ce8fc0880a947b3933dc0c970afe142 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:45:01.769245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede1bf-769d-4d6c-bf6f-dd0921fe9d7e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.769980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede1bf-769d-4d6c-bf6f-dd0921fe9d7e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.769980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede1bf-769d-4d6c-bf6f-dd0921fe9d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.796950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f9ede1bf-769d-4d6c-bf6f-dd0921fe9d7e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:01.798201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f9ede1bf-769d-4d6c-bf6f-dd0921fe9d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:01.807332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93627-2537-4720-9e23-7d483a6f9294 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.849251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:01.849935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:01.850200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:01.850475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:01.851215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:01.851526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:01.852954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:01.865123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 327/637] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:01.866495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.889093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 311/638] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:01.890127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede1bf-769d-4d6c-bf6f-dd0921fe9d7e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:01.977924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a4c93-857a-4dd3-abf6-003a726fbc08 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:01.995741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede1bf-769d-4d6c-bf6f-dd0921fe9d7e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.010524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.011338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.011624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.011899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.021733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:02.028336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.029056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.029336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:02.029513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:02.030403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:02.031227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:02.031871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.031948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 328/639] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:02.031948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.100723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.102199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.134449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2eea-6f8c-47a0-a825-cc460f0a1b73 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.172537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.173406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.173691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.173967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.181659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.183121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:02.196721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:02.197627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:02.198566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 329/640] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:02.199153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.210450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 312/641] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:45:02.210450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.297235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0462148-7519-4dba-9149-eb41cfb19ab3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.302185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4965a6-c816-4310-bd18-4fa644ff57b6 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.330127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.330933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.331210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.331484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.335447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.336123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.336396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.336689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.337468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:02.337777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.339143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.341670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:02.352372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 313/642] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:02.352372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:02.352633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:02.353674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 330/643] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:02.354545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.459178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386659-2eb7-40a8-ba9c-21798247b88c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.460388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188902f-65e4-4762-ae85-813809d70096 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.492135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.492953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.493061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.493248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.493511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.493852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.494132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.494355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:02.494449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.494667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.496216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.505229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.507514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.514057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 314/644] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:02.515859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:02.525718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:02.526625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:02.527585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:02.527585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:02.527585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:02.527585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:02.527585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 331/645] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:02.527868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.614797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd2a1b-636f-4d4d-a2b7-321a9cb75ac7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.625604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612336d0-044d-4f8d-84fd-2b2317f474d2 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.653989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.654901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.655186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.655459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.659451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.660126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.660409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.660700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.661461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:02.661769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.663136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.666064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.667494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.675629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 332/646] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:02.675629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:02.685605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:02.686489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:02.687409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:02.687409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:02.687409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:02.687409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:02.687409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 315/647] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:02.688097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.776850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ffe50-f8de-4f3c-b7df-595142bc8a2c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.785619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb3955-f34f-4897-9acd-2db0d0085db2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.811912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.812582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.812879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.813156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.818493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.819165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.819451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.819729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.820461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:02.820806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.822190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.833657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 316/648] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:02.837564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.880842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.882666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:02.940862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617154a6-b53f-4a2b-9e11-debf1ef24b03 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:02.972507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:02.973344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:02.973638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:02.973907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:02.983728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 333/649] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:45:02.984406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:02.989212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:02.990692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:03.008468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:03.009417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:03.010700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:03.010700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:03.010700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:03.010700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:03.010700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 317/650] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:03.010978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.085386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb7fa-f24e-4c01-81f6-4e87793229d9 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.115350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a520af-190b-4214-adf5-6b0dbbd95ef2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.124727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.125639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.126136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.126584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.127478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:03.127959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.129540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.140944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 334/651] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:03.141676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.153954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.154834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.155180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.155536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.162162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.163596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:03.177297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:03.178203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:03.179078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:03.182124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 318/652] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:03.182124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.238741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044f6d8-b160-4510-abe4-51d6b97f239d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.271424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.272245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.272526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.272825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.275886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe031-683f-475a-92d3-25045fd97e29 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.283303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.284774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:03.301940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:03.303027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:03.304122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:03.304122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:03.304122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:03.304122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:03.307852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 335/653] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:03.308418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.311202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.312348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.312348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.312516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.313150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:03.313461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.314850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.326236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 319/654] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:03.326236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.413028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04cb21-57c6-4f70-99b4-435f6a2eb9c8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.421035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f0dc-c200-4006-b70c-3d7c1ccc1779 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.454627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.456484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.456815 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.457088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.457288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.457752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.458087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.458299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.459091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:03.459399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.460883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.469083 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.470524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.483462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 320/655] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:03.483462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:03.489579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:03.490565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:45:03.491500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:03.493031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 336/656] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:03.493857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.587151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9e44-6d4d-4c0f-b9a4-df17f7affedd None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.591323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa5c1-1d2c-4d5a-ae9e-fa72ccc49509 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.620915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.621617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.621901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.622236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.622955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:03.623305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.623416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.624189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.624468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.624711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.624806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.632574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.634069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.636915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 321/657] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:03.637596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:03.651269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:03.652238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:03.653203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 337/658] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:03.654408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.736889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a204a7e-1e10-4160-9cce-a9fb582f98a5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.748405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217a2b4-e701-4e92-b2ab-564bbabe2e1c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.772607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.773301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.775141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.775141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.775141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=8650bbea186e427fac890eabe18ba153) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:03.775141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.776406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.785349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 322/659] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/role_assignments?user.id=8650bbea186e427fac890eabe18ba153&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:03.786198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.801851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.802949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.804040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.804553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.806180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:03.807020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.809145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.835555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 338/660] 10.222.0.52 () {56 vars in 1137 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:03.836694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:03.927433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796f98-b6d6-46a9-bc38-4b79ef3fd2dd None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.958210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a158748-490d-4da6-8c5a-e8e24a266730 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:03.971606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:03.972771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:03.973251 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:03.973698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:03.983374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:03.985147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:03.998849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367340f-11de-4ef7-9420-3a5947fe2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.000144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367340f-11de-4ef7-9420-3a5947fe2c88 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.000619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367340f-11de-4ef7-9420-3a5947fe2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.001120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367340f-11de-4ef7-9420-3a5947fe2c88 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.002166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367340f-11de-4ef7-9420-3a5947fe2c88 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:04.002373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:04.003453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:04.004486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:04.005093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367340f-11de-4ef7-9420-3a5947fe2c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.005183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 323/661] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:04.005254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367340f-11de-4ef7-9420-3a5947fe2c88 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.005331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.025156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 339/662] 10.222.0.52 () {56 vars in 1139 bytes} [Tue May 10 18:45:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:04.026617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d66b-ac19-4849-a7bb-0ef533bb6e79 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.026902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d66b-ac19-4849-a7bb-0ef533bb6e79 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.027183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d66b-ac19-4849-a7bb-0ef533bb6e79 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.028798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 340/663] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:04.029654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d66b-ac19-4849-a7bb-0ef533bb6e79 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.115916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2fa0-6359-47c9-924b-a97ccf4dbf0f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.131876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d66b-ac19-4849-a7bb-0ef533bb6e79 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.152948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21c5a2-836a-49b7-b0c4-3bca5ce4a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.154361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c5a2-836a-49b7-b0c4-3bca5ce4a329 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.154361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c5a2-836a-49b7-b0c4-3bca5ce4a329 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.154361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c5a2-836a-49b7-b0c4-3bca5ce4a329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.175897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.176873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.177158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.177434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.178769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:04.179226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.181355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.194910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 341/664] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:04.195929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.224434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21c5a2-836a-49b7-b0c4-3bca5ce4a329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.226070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21c5a2-836a-49b7-b0c4-3bca5ce4a329 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.291747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0216-b754-478d-9c74-a3580211c51d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.322710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 324/665] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:45:04.324025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c670-109a-4e25-9f61-b0130d8d9fa1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.324312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c670-109a-4e25-9f61-b0130d8d9fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.324588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c670-109a-4e25-9f61-b0130d8d9fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.329303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.329975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.330258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.330534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.340525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-56c0c670-109a-4e25-9f61-b0130d8d9fa1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:04.341798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-56c0c670-109a-4e25-9f61-b0130d8d9fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:04.396804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.398275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.409604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 325/666] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:04.411021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0c670-109a-4e25-9f61-b0130d8d9fa1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.510901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0c670-109a-4e25-9f61-b0130d8d9fa1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.514903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 342/667] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:45:04.516241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.545980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.546574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.546859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.547136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.547970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=dff69f29cd4341f488887fea0dd2e540) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:04.548283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.549781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.555492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 326/668] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/role_assignments?user.id=dff69f29cd4341f488887fea0dd2e540&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:04.556307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.638882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faed1c-a079-49e3-b502-54d620a0de36 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.675416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.675825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1aa53-1b93-4562-9c83-4fe0685ee689 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.676321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.676658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.676963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.689148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.690635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:04.712221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:04.713236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:04.714260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:04.714260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:04.714260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:04.714260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:04.717080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 343/669] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:04.718087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.721458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.722778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.724218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.724750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.739543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:04.750228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:04.751248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:04.752094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:04.759481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 327/670] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:04.759481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.851256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85431082-f50a-4b5e-913b-29346adb3ce4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.889315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80597330-d924-4bfb-8072-772f922c1d37 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:04.894555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.895553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.895977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.896411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.910135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.911651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:04.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:04.930611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:04.931744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:04.931744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:04.931744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:04.931744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:04.931744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 344/671] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:04.932112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:04.932491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:04.933345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:04.933784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:04.934196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:04.935122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:04.935568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:04.937206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:04.952839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 328/672] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:04.953930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.047053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424c9b-8c33-43e1-b7b5-66ed5aede344 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.071482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdc520-8e85-4c7f-8926-2119679598d2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.084783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.085729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.086153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.086568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.087464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:05.087917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.089480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.103156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 345/673] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:05.104013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.116998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.118269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.118777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.119350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.120638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:05.121384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.123513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.138856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 329/674] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:05.140760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.227512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98c860-675e-4dc7-83bf-48b13850c3e0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.246101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a806d3-1b45-4f7f-b6f6-f96882dfa97a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.263267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.264431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.264941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.265414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.274460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.276127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.280375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.281219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.281544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.281826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:05.291954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:05.292871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:05.293761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:05.294215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.294215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.296532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 346/675] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:05.297534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:05.312244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:05.313189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:05.314054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:05.314054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:05.314054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:05.314054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:05.318234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 330/676] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:05.318993 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.397752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104592a-5301-412b-8709-b1780eb870c6 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.414820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea060b-77bd-41b1-8c30-7eb9bf93b33d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.436003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.437228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.437729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.438206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.445601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.447468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.448571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.449291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.449574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.449843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.450690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:05.451000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.452477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:05.464139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:05.465296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:05.466326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:05.467667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 331/677] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:05.468617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.469256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 347/678] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:05.473556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.574917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e807d-a7e9-4b74-8451-44eec76f3803 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.600352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d16a2-da60-4675-8f60-b450290871b7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.612873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.614100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.614566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.615174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.616450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:05.617205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.618967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.634533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 332/679] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:05.635976 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.641735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.643463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.643951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.644401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.645447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=b8cb476654be463e9d7d19d92576e495) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:05.645938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.647566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.656291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 348/680] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/role_assignments?user.id=b8cb476654be463e9d7d19d92576e495&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:05.657508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.767857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb164b-4ba4-44f6-a2d5-d4a8fce858c8 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.810631 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.811368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.811672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.811932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.812772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:05.813085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.814561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.840184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 333/681] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:05.848915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:05.876097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63a04-7ad0-42ce-8742-a9ee3377911a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:05.916639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:05.917730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:05.918018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:05.918299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:05.926846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:05.928394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:05.945224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:05.946226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:05.947519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 349/682] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:05.952464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.005644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d9f32-1854-4d40-8277-5901bbf501a8 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.062623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.063693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.064174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.064646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.065716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=945283f83c1b4ee0a1a59b0732090fbf) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:06.066492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.069689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.083872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 334/683] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/role_assignments?user.id=945283f83c1b4ee0a1a59b0732090fbf&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:06.095893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2c31e-9321-4f08-89ff-685d5898a803 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.132590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82d33d-8deb-4a3e-9051-bf119de02e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.133695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82d33d-8deb-4a3e-9051-bf119de02e0a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.134218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82d33d-8deb-4a3e-9051-bf119de02e0a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.134696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82d33d-8deb-4a3e-9051-bf119de02e0a None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.136147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82d33d-8deb-4a3e-9051-bf119de02e0a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:06.136714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82d33d-8deb-4a3e-9051-bf119de02e0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.138492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82d33d-8deb-4a3e-9051-bf119de02e0a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.158393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 350/684] 10.222.0.52 () {56 vars in 1135 bytes} [Tue May 10 18:45:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:06.165884 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.268354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1e4b-933c-43cd-9a2e-076c116c8c7d None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.268538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1e4b-933c-43cd-9a2e-076c116c8c7d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.268889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1e4b-933c-43cd-9a2e-076c116c8c7d None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.270612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 351/685] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:06.276444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a5de5-790f-42bc-89e4-d55bd52dae94 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.276780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a5de5-790f-42bc-89e4-d55bd52dae94 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.277038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a5de5-790f-42bc-89e4-d55bd52dae94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.295735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3f9a5de5-790f-42bc-89e4-d55bd52dae94 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:06.296689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3f9a5de5-790f-42bc-89e4-d55bd52dae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:06.299161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c977c-1b0a-4a28-a0bb-e6f441baa535 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.336433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.337577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.338062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.338588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.365933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 352/686] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:45:06.390927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a5de5-790f-42bc-89e4-d55bd52dae94 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.409304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.411151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.492623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a5de5-790f-42bc-89e4-d55bd52dae94 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.513804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 335/687] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:45:06.522335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.534011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.535150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.535569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.535989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.548727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.550581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:06.573255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:06.574223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:06.575193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:06.575193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:06.575193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:06.575193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:06.575420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 353/688] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:06.580643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.625946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6807c0-aec1-43a7-901f-076075bf17b0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.662091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.662905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.663189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.663468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.674090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.675592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.680512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8e87a-9be0-43e6-a4e9-6c19b1c6ece3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:06.694401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:06.696320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:06.697523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:06.697523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:06.697523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:06.697523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:06.697523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 336/689] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:06.702227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.729474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.732698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.732698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.732698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.732698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:06.732698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.734254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.749740 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 354/690] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:06.755215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.813161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28fad8-9609-4898-be2a-7967257e90c0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.847926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.848605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.848979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.849265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.850000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:06.850312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.851695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.864408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 337/691] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:06.866363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67595-a403-4fe2-905c-3e35438606dd None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:06.881742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:06.905449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:06.906145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:06.906419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:06.906692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:06.907424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:06.909008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:06.947239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 355/692] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:45:06 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:07.037301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a360da-6d11-40a2-8fc2-00c6e3313923 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:07.081372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d45700-a1e7-43ba-b751-329726081252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:07.082168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45700-a1e7-43ba-b751-329726081252 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:07.082449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45700-a1e7-43ba-b751-329726081252 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:07.082723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45700-a1e7-43ba-b751-329726081252 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:07.094784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d45700-a1e7-43ba-b751-329726081252 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:07.096283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d45700-a1e7-43ba-b751-329726081252 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-11d45700-a1e7-43ba-b751-329726081252 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:07.120983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:07.123046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:07.124155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 338/693] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:07.128391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:07.259687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9200-46e6-460b-8907-557bfe185f00 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:07.299327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe51d-8645-4160-9091-3a74c2a9439c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:07.299327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe51d-8645-4160-9091-3a74c2a9439c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:07.299327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe51d-8645-4160-9091-3a74c2a9439c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:07.300169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 339/694] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:07.307753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d43a-ded8-4027-84f6-6d65184c09ff None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:07.307753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d43a-ded8-4027-84f6-6d65184c09ff None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:07.307753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d43a-ded8-4027-84f6-6d65184c09ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:07.308333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:07.308333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:07.308333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:07.308333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:07.309009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:07.309009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:07.310456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:07.325413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-94a3d43a-ded8-4027-84f6-6d65184c09ff None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:07.327000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-94a3d43a-ded8-4027-84f6-6d65184c09ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:07.331563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 356/695] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:07.340329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:07.436560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 340/696] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:07.458905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a69b9-7e63-4270-8274-cdc3ce5e7ae0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:07.469167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d43a-ded8-4027-84f6-6d65184c09ff None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:07.500493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:07.502137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:07.502649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:07.503138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:07.504181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=a9e110bec628462e8699b8681daf2d58) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:07.504732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:07.507338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:07.515392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 357/697] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:07 2022] GET /identity/v3/role_assignments?user.id=a9e110bec628462e8699b8681daf2d58&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:07.582716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d43a-ded8-4027-84f6-6d65184c09ff None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:07.624507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:07.625369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:07.625655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:07.625932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:07.637266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:07.649155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:07.650150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:07.651013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:07.653340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 341/698] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:07.658404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:07.817028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715bf8-6fb4-419a-9bd8-71492f518006 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:07.860267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:07.861044 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:07.861328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:07.861602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:07.862426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:07.862736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:07.864187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:07.873129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 358/699] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:07.879314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:07.981569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc5d4a-0c65-48ef-ae90-16a8a1ffe65b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:08.019355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:08.020177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.020461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.020773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.032517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:08.034051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:08.051331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:08.052230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:08.053177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:08.053177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:08.053177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:08.053177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:08.053177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 342/700] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:08.059392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:08.188403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9d997-cbc9-437b-8af6-baf30883ead7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:08.230819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941ce35-abf3-44b5-9401-51aa8b930cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:08.231549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ce35-abf3-44b5-9401-51aa8b930cdf None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.231828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ce35-abf3-44b5-9401-51aa8b930cdf None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.232098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ce35-abf3-44b5-9401-51aa8b930cdf None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.232864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941ce35-abf3-44b5-9401-51aa8b930cdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:08.233172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941ce35-abf3-44b5-9401-51aa8b930cdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:08.234533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941ce35-abf3-44b5-9401-51aa8b930cdf None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:08.247770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 359/701] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:08.253283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:08.351376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c84c-021a-4671-9502-aff96b65ce23 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.351710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c84c-021a-4671-9502-aff96b65ce23 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.351931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c84c-021a-4671-9502-aff96b65ce23 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.353596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 360/702] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:08.358550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd5753-1cf3-4717-aecd-6c40c910a8a1 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.358830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd5753-1cf3-4717-aecd-6c40c910a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.359101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd5753-1cf3-4717-aecd-6c40c910a8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.393890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1afd5753-1cf3-4717-aecd-6c40c910a8a1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:08.396293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1afd5753-1cf3-4717-aecd-6c40c910a8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:08.429643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192907f9-03c7-4b5b-8b1b-3da8e4b1af63 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:08.499564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:08.500437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.500746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.501076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.508081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 361/703] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 18:45:08.514190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:08.515727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:08.530046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd5753-1cf3-4717-aecd-6c40c910a8a1 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:08.539240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:08.540198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:08.541182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 343/704] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:45:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:08.549034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:08.700703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd5753-1cf3-4717-aecd-6c40c910a8a1 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:08.740558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97acfcb-18eb-4ad9-8476-62f5b6ba6354 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:08.764249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:08.765481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.765967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.766482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.767315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:08.768720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:08.781882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:08.782898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.783428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.783900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.784965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:08.791764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:08.792764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:08.793612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:08.795396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:08.797081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:08.800381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 362/705] 10.222.0.52 () {56 vars in 1129 bytes} [Tue May 10 18:45:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:08.812791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:08.839080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 344/706] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:45:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:08.844483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:08.924803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb17ef-f355-4949-aa32-3d54628b72c0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:08.959484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:08.960545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:08.961346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:08.962218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:08.963244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:08.963746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:08.965360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:08.971946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 363/707] 10.222.0.52 () {56 vars in 1124 bytes} [Tue May 10 18:45:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:08.978587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:09.062311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacb8f9-a425-4a4b-84eb-0fa662d0e1e5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:09.079847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537c34-dc28-4514-bb1b-da1d971bad5b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:09.094416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:09.095072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:09.095352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:09.095637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:09.113596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c0ecf-00de-4d09-850d-e9c02fd1df89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:09.114531 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c0ecf-00de-4d09-850d-e9c02fd1df89 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:09.115029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c0ecf-00de-4d09-850d-e9c02fd1df89 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:09.115513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c0ecf-00de-4d09-850d-e9c02fd1df89 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:09.116467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c0ecf-00de-4d09-850d-e9c02fd1df89 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:09.116989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c0ecf-00de-4d09-850d-e9c02fd1df89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:09.118536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c0ecf-00de-4d09-850d-e9c02fd1df89 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:09.124854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 364/708] 10.222.0.52 () {56 vars in 1124 bytes} [Tue May 10 18:45:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:09.131734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5309a-fb78-4dae-bee3-bf4b31637abf None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:09.132507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5309a-fb78-4dae-bee3-bf4b31637abf None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:09.133024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5309a-fb78-4dae-bee3-bf4b31637abf None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:09.135346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 365/709] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:09.140982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fae0e8-bddb-4e95-8272-3bb14c5f73af None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:09.141623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fae0e8-bddb-4e95-8272-3bb14c5f73af None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:09.142101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fae0e8-bddb-4e95-8272-3bb14c5f73af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:09.170804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-90fae0e8-bddb-4e95-8272-3bb14c5f73af None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:09.172898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-90fae0e8-bddb-4e95-8272-3bb14c5f73af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:09.182761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:09.184160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:09.382567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 366/710] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:09.418234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 345/711] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:45:09.423238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fae0e8-bddb-4e95-8272-3bb14c5f73af None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:09.430345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:09.608366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc9b9-027e-4bfa-9817-59605e403b77 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:09.669628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:09.672696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:09.672696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:09.672696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:09.710017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:09.712713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:09.748703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fae0e8-bddb-4e95-8272-3bb14c5f73af None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:09.776726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:09.777724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:09.778716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:09.778716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:09.778716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:09.778716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:09.785145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 346/712] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:09.789655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:09.877424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:09.878255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:09.880878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:09.880878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] PATH_INFO: `/v3/services/network` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:09.880878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:09.880878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:09.930325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:09.931783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:09.932631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 367/713] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:09 2022] GET /identity/v3/services/network => generated 88 bytes in 509 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:09.937939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:09.969517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99568c1e-feb0-4988-a072-c488de5892ef None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.013415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.014106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.014389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.014662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.015477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:10.015782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:10.017207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:10.029362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 347/714] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:10.037986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.065807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055e1d-4f2e-471f-a0e4-20c0c3f52a6f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.098476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab685-e7fd-4347-b4ad-362847046971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.099163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab685-e7fd-4347-b4ad-362847046971 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.099441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab685-e7fd-4347-b4ad-362847046971 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.099711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab685-e7fd-4347-b4ad-362847046971 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.100423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab685-e7fd-4347-b4ad-362847046971 None admin] RBAC: Adding query filter params (name=network) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:10.100749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab685-e7fd-4347-b4ad-362847046971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:10.102131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab685-e7fd-4347-b4ad-362847046971 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:10.106902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 368/715] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:10.108159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05925-4dfd-4ccb-adc6-71c4387902c2 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.108434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05925-4dfd-4ccb-adc6-71c4387902c2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.113125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05925-4dfd-4ccb-adc6-71c4387902c2 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.114433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 369/716] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:10.115168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05925-4dfd-4ccb-adc6-71c4387902c2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.136659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522acc-8a52-4854-b5c3-3493c3982e4e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.169887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b957-20e1-4926-a3df-ae208971a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.170694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b957-20e1-4926-a3df-ae208971a765 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.170974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b957-20e1-4926-a3df-ae208971a765 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.171249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b957-20e1-4926-a3df-ae208971a765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.177931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b957-20e1-4926-a3df-ae208971a765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:10.179381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b957-20e1-4926-a3df-ae208971a765 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-fd57b957-20e1-4926-a3df-ae208971a765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:10.193409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:10.195443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:10.197563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:10.204697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 348/717] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:10.204697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a17f8-a0cf-49f4-81ac-2fe369f09f51 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.204697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a17f8-a0cf-49f4-81ac-2fe369f09f51 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.204697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a17f8-a0cf-49f4-81ac-2fe369f09f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.214348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05925-4dfd-4ccb-adc6-71c4387902c2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.218225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d02a17f8-a0cf-49f4-81ac-2fe369f09f51 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:10.219412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d02a17f8-a0cf-49f4-81ac-2fe369f09f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:10.247411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.248079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.248354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.248628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.249390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:10.249780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:10.251340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:10.260992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 370/718] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:10.261957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.286694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 349/719] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:10.309871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a17f8-a0cf-49f4-81ac-2fe369f09f51 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.475040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fff86-f8c7-4a96-be98-b4260ea7d0f7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.497720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a17f8-a0cf-49f4-81ac-2fe369f09f51 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.533716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e50b8-b7b0-4006-84d0-3a2b8c59e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.534404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e50b8-b7b0-4006-84d0-3a2b8c59e2fe None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.534699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e50b8-b7b0-4006-84d0-3a2b8c59e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.535746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e50b8-b7b0-4006-84d0-3a2b8c59e2fe None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.536948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e50b8-b7b0-4006-84d0-3a2b8c59e2fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:10.537270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e50b8-b7b0-4006-84d0-3a2b8c59e2fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:10.538929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e50b8-b7b0-4006-84d0-3a2b8c59e2fe None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:10.552637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 371/720] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:10.554081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8bc5b-0ddf-47cd-ae41-a4874739ee49 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.554317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bbddf-aa16-427b-96ca-93921378b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.554458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8bc5b-0ddf-47cd-ae41-a4874739ee49 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.554707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8bc5b-0ddf-47cd-ae41-a4874739ee49 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.555708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bbddf-aa16-427b-96ca-93921378b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.556109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 372/721] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:10.556372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bbddf-aa16-427b-96ca-93921378b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.556656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bbddf-aa16-427b-96ca-93921378b0b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.558173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8bc5b-0ddf-47cd-ae41-a4874739ee49 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.571788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bbddf-aa16-427b-96ca-93921378b0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-525bbddf-aa16-427b-96ca-93921378b0b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:10.579624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:10.580843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:10.581671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 350/722] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:10.582489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e231e-fc5b-4ff4-9351-23ffa2a9624b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.582675 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e231e-fc5b-4ff4-9351-23ffa2a9624b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.582952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e231e-fc5b-4ff4-9351-23ffa2a9624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.602674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-461e231e-fc5b-4ff4-9351-23ffa2a9624b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:10.603864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-461e231e-fc5b-4ff4-9351-23ffa2a9624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:10.669801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 351/723] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:10.670679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e231e-fc5b-4ff4-9351-23ffa2a9624b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.679409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8bc5b-0ddf-47cd-ae41-a4874739ee49 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.714765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.716146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.716876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.717361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.718945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=dff69f29cd4341f488887fea0dd2e540) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:10.719447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:10.721523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:10.729595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 373/724] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/role_assignments?user.id=dff69f29cd4341f488887fea0dd2e540&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:10.731261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.773089 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e231e-fc5b-4ff4-9351-23ffa2a9624b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.808351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.809157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.809490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.809831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.810648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:10.810901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:10.812361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:10.821440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 352/725] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:10.827069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:10.867997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289ed4d-ece9-4c78-bc30-1227a7285774 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.910065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:10.911390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:10.911909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:10.912408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:10.923732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:10.931862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:10.933366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:10.934210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:10.937226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 374/726] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:10.938167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b7f35-f793-4618-9e4a-5e5cdebe8c64 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:10.942541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.021777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:11.023021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.023541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.024021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.047303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:11.048815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:11.075560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:11.076534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:11.077462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:11.077462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:11.077462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:11.077462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:11.077462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 353/727] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:11.089881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.294270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9824-cbd8-4d50-9ac5-3fe18eadf36d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:11.319338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbb8ee-7091-407e-9a19-d3551774bb5e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:11.356032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:11.357134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.357617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.358082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.359072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:11.359573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:11.361172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:11.362706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:11.363382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.363660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.363938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.364666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:11.364989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:11.366339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:11.371724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 375/728] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:11.377084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.390385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 354/729] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:11.396528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.547259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60b5ca-a437-43bb-81d3-087da0c413eb None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:11.580052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b3261-b515-48e4-b4d5-d05d1020bc25 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:11.591902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:11.592775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.593064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.593339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.603935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:11.605490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:11.620145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:11.621016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.621297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.621571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:11.631301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:11.632307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:11.633261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 355/730] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:45:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:11.643495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:11.644992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:11.646327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:11.674260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:11.676353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:11.678507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:11.678507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:11.678507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:11.678507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:11.682213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 376/731] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:11.685413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.782677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921032-909c-4426-9944-606cf9fe0c6f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:11.802871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e10aab-5e19-4b0a-8cf8-2e8904ad66eb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:11.816385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e529d-d1ed-4c14-b31a-b9afb95291f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:11.817125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e529d-d1ed-4c14-b31a-b9afb95291f9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.817408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e529d-d1ed-4c14-b31a-b9afb95291f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.817683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e529d-d1ed-4c14-b31a-b9afb95291f9 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.818532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e529d-d1ed-4c14-b31a-b9afb95291f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:11.818840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e529d-d1ed-4c14-b31a-b9afb95291f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:11.820272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e529d-d1ed-4c14-b31a-b9afb95291f9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:11.835702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545331dc-282c-4c1e-a081-0746402a059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:11.836367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545331dc-282c-4c1e-a081-0746402a059f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.836642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545331dc-282c-4c1e-a081-0746402a059f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.836942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545331dc-282c-4c1e-a081-0746402a059f None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.837571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 356/732] 10.222.0.52 () {56 vars in 1149 bytes} [Tue May 10 18:45:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:11.837756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545331dc-282c-4c1e-a081-0746402a059f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:11.837952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545331dc-282c-4c1e-a081-0746402a059f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:11.838846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade488-61df-4db1-bf2e-eb6eea3d7d49 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.839134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade488-61df-4db1-bf2e-eb6eea3d7d49 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.839294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545331dc-282c-4c1e-a081-0746402a059f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:11.839439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade488-61df-4db1-bf2e-eb6eea3d7d49 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.840885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 357/733] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:11.846050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade488-61df-4db1-bf2e-eb6eea3d7d49 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.861599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 377/734] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:11.867260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636366d-6fa8-4bd4-9210-9265fb87b9aa None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:11.867558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636366d-6fa8-4bd4-9210-9265fb87b9aa None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:11.867843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636366d-6fa8-4bd4-9210-9265fb87b9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:11.884033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3636366d-6fa8-4bd4-9210-9265fb87b9aa None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:11.885601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3636366d-6fa8-4bd4-9210-9265fb87b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:11.954388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 378/735] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:11.955292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636366d-6fa8-4bd4-9210-9265fb87b9aa None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:11.980865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade488-61df-4db1-bf2e-eb6eea3d7d49 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.021191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.021865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.022153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.022474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.073523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636366d-6fa8-4bd4-9210-9265fb87b9aa None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.110234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.111749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.120314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.121264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.121552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.121934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.136468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.138813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:12.157499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:12.158542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:12.159517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:12.163807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 379/736] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:12.164637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:12.219204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 358/737] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 18:45:12.220544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:12.286469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549771-f880-4c46-aeca-009a1596e87d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.320275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.321564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.322061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.322530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.323454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.325174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.327094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e43ae-f260-4870-9753-fce8bdf7d96e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.347465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 380/738] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:12 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:12.348723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:12.399493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.400199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.400484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.400795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.401659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:12.403225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.404759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.445443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 359/739] 10.222.0.52 () {56 vars in 1135 bytes} [Tue May 10 18:45:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:12.461457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:12.555836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2513b24-affd-4558-bead-5683fc39268a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.592731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.593566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.593848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.594165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.607611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.608301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07ab0-5837-42ad-b881-96a2e5e6e44b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.609099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:12.627262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:12.628256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:12.629216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:12.629216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:12.629216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:12.629216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:12.629216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 381/740] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:12.634210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:12.644555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5697e-7091-450f-88dc-1455f4ed0cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.645255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5697e-7091-450f-88dc-1455f4ed0cd6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.645531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5697e-7091-450f-88dc-1455f4ed0cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.645808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5697e-7091-450f-88dc-1455f4ed0cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.712638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5697e-7091-450f-88dc-1455f4ed0cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.714142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5697e-7091-450f-88dc-1455f4ed0cd6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.734512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb568d2-d25f-4bfe-9bbe-4c87f9275387 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.768255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.768964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.769241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.769513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.770247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:12.770551 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.771919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.784498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 382/741] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:12.789920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:12.818455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 360/742] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:12 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 18:45:12.819824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c68d9-130a-4d41-823e-bfe6200fae8f None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.820108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c68d9-130a-4d41-823e-bfe6200fae8f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.820376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c68d9-130a-4d41-823e-bfe6200fae8f None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.821904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 361/743] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:12.824743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c68d9-130a-4d41-823e-bfe6200fae8f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:12.912421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426708-a787-45a6-a158-ac7952703933 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.928595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c68d9-130a-4d41-823e-bfe6200fae8f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:12.953414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9c43b-79fd-4e0e-b604-cecc412573cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.954277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c43b-79fd-4e0e-b604-cecc412573cc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.954555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c43b-79fd-4e0e-b604-cecc412573cc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.955148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c43b-79fd-4e0e-b604-cecc412573cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.962087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9c43b-79fd-4e0e-b604-cecc412573cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.963642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9c43b-79fd-4e0e-b604-cecc412573cc None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.963831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:12.964767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.965056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.965558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.976265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-f0e9c43b-79fd-4e0e-b604-cecc412573cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:12.977699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:12.979656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:12.981841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:12.982824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:12.988708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 383/744] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:12.988708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44999996-08d6-4796-89c5-02a13b754b6e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:12.988708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44999996-08d6-4796-89c5-02a13b754b6e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:12.988708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44999996-08d6-4796-89c5-02a13b754b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:12.997265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:12.998562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:13.000160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:13.000160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:13.000160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:13.000160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:13.000160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 362/745] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:13.000160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.004850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-44999996-08d6-4796-89c5-02a13b754b6e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:13.006131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-44999996-08d6-4796-89c5-02a13b754b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:13.071812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 384/746] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 18:45:13.072926 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44999996-08d6-4796-89c5-02a13b754b6e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.128049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bde76-a993-41b5-99ef-f79d43f88923 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:13.163501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:13.164082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.164359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.164699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.165512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:13.165873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:13.167375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:13.179662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 363/747] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:13.180464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.185874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44999996-08d6-4796-89c5-02a13b754b6e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:13.219648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:13.220374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.220653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.220949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.221737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:13.222043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:13.223408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:13.235223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 385/748] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:13.236126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.338150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0feef8-b452-47a4-821a-99d3f30da5b4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:13.373955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:13.374635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.374891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.375186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.376031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=d1455f40069444ffba21c84a8eab7e6f) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:13.376340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:13.377894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:13.393058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 386/749] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:13 2022] GET /identity/v3/role_assignments?user.id=d1455f40069444ffba21c84a8eab7e6f&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:13.393058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.457258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083673e-5496-46e5-882e-bc1a1441115d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:13.506604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f58b1-c75e-47cc-8feb-ba455a859f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:13.508072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f58b1-c75e-47cc-8feb-ba455a859f5a None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.508451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f58b1-c75e-47cc-8feb-ba455a859f5a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.508859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f58b1-c75e-47cc-8feb-ba455a859f5a None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.509708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f58b1-c75e-47cc-8feb-ba455a859f5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:13.512080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f58b1-c75e-47cc-8feb-ba455a859f5a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:13.535996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 364/750] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:13 2022] POST /identity/v3/services => generated 240 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:13.537118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707d01-11dc-4016-b7dc-2df738b24800 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:13.537757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ecb8-743c-4b7e-854e-91f4b1566a10 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.538196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ecb8-743c-4b7e-854e-91f4b1566a10 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.538661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ecb8-743c-4b7e-854e-91f4b1566a10 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.541800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 365/751] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:13.550382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd8f0-983e-4da1-8bbe-12a59b3abd4e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.550988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd8f0-983e-4da1-8bbe-12a59b3abd4e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.551400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd8f0-983e-4da1-8bbe-12a59b3abd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.586845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-95acd8f0-983e-4da1-8bbe-12a59b3abd4e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:13.589114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-95acd8f0-983e-4da1-8bbe-12a59b3abd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:13.621257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:13.622157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.622457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.623015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.631555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:13.633277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:13.649549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:13.650721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:13.651807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 387/752] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:13.658070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.673729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 366/753] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:13.740580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd8f0-983e-4da1-8bbe-12a59b3abd4e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.789595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623d02a-231b-4660-8b76-80a5c9e0b49e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:13.826629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:13.827314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.827872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.827872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.828648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:13.828984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:13.830519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:13.843031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 388/754] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:13.848846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.852427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd8f0-983e-4da1-8bbe-12a59b3abd4e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:13.887121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:13.888119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:13.888394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:13.888662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:13.899435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:13.907824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:13.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:13.909885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 367/755] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:13.915878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:13.962247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da161f1-96d1-49fa-9770-9a324c58bbde None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:14.003927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:14.004517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:14.004859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:14.005132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:14.005978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=a9e110bec628462e8699b8681daf2d58) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:14.006289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:14.007804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:14.014597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 389/756] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:13 2022] GET /identity/v3/role_assignments?user.id=a9e110bec628462e8699b8681daf2d58&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:14.023917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb9471-2653-4bb3-8add-c86411e4a3ac None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:14.068405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:14.069133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:14.069406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:14.069680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:14.070463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:14.070766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:14.072196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:14.086364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 368/757] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:14.092313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:14.228556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024225-2e27-440b-b85c-0c204a5fb752 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:14.272224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:14.273005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:14.273286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:14.273564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:14.287911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:14.289476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:14.308110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:14.310379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:14.312582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:14.312582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:14.312582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:14.312582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:14.312582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 390/758] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:14.316361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:14.449621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ffb97-bc92-42c7-83ef-a3cb6be085ce None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:14.488096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:14.488899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:14.489093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:14.489353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:14.490089 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:14.490393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:14.491764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:14.509179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 369/759] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:14.517143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:14.677695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f867cd-dff3-4581-9b71-b577e413d021 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:14.710526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:14.711395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:14.711679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:14.712004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:14.719776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:14.721254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:14.735441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:14.736621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:14.737966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 391/760] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:45:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:14.742711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:14.853850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f07a-2fa1-4372-a35a-ec05a33c97ef None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:14.894240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:14.894926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:14.895205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:14.895482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:14.896329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:14.896635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:14.898094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:14.924056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 370/761] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:45:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:14.929506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:15.065770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673467a-989d-46af-ac53-cda6661772a3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:15.119045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18421d76-20b3-47fc-9a21-1f270df86638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:15.119876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421d76-20b3-47fc-9a21-1f270df86638 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:15.120153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421d76-20b3-47fc-9a21-1f270df86638 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:15.120492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421d76-20b3-47fc-9a21-1f270df86638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:15.139785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18421d76-20b3-47fc-9a21-1f270df86638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:15.141553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18421d76-20b3-47fc-9a21-1f270df86638 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-18421d76-20b3-47fc-9a21-1f270df86638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:15.168854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:15.169817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:15.171828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:15.171828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:15.171828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:15.171828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:15.171828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 392/762] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:15.175748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:15.316228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ff95-8b41-48bf-a186-9c19b6b884e2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:15.348707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:15.349395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:15.349674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:15.349953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:15.350682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:15.350983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:15.352369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:15.364113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40c37a-d777-4ac9-a4f2-503931cf7865 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:15.364413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 371/763] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:15.364598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40c37a-d777-4ac9-a4f2-503931cf7865 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:15.364702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40c37a-d777-4ac9-a4f2-503931cf7865 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:15.366259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 393/764] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:15.369555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:15.374019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc70f7-52ba-425a-8422-4a9101557256 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:15.374298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc70f7-52ba-425a-8422-4a9101557256 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:15.374570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc70f7-52ba-425a-8422-4a9101557256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:15.405673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3bfc70f7-52ba-425a-8422-4a9101557256 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:15.406857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3bfc70f7-52ba-425a-8422-4a9101557256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:15.479660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114a09-8661-4990-a4f9-656bb6b05073 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:15.532648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:15.533491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:15.533770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:15.534040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:15.546513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:15.547951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:15.553442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 394/765] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:15.565180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:15.566092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:15.567034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 372/766] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:15.573765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc70f7-52ba-425a-8422-4a9101557256 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:15.595311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:15.749277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc70f7-52ba-425a-8422-4a9101557256 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:15.770841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f3a26-1d1c-4bc5-9e0b-a7534454e3b2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:15.795509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:15.796555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:15.797106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:15.797586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:15.798595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:15.799113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:15.800797 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:15.824443 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 395/767] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:15.830491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:15.843480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:15.844572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:15.845040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:15.845482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:15.846414 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:15.848093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:15.868473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:15.869664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:15.870687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:15.881430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 373/768] 10.222.0.52 () {56 vars in 1129 bytes} [Tue May 10 18:45:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:15.889203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.017656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a989ec-786b-4458-a0b0-736cbf761022 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.022979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7125d07-0a2d-467b-8917-0236a862a2e8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.052078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.053087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.053516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.053956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.054835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:16.055297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:16.056848 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:16.062804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 374/769] 10.222.0.52 () {56 vars in 1124 bytes} [Tue May 10 18:45:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:16.072406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.073478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738afb95-73ae-4d97-a716-fa461989a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.074382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738afb95-73ae-4d97-a716-fa461989a144 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.074750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738afb95-73ae-4d97-a716-fa461989a144 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.075050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738afb95-73ae-4d97-a716-fa461989a144 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/dff69f29cd4341f488887fea0dd2e540/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.077817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738afb95-73ae-4d97-a716-fa461989a144 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=dff69f29cd4341f488887fea0dd2e540, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:16.079255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738afb95-73ae-4d97-a716-fa461989a144 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:16.102638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 396/770] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:45:15 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/dff69f29cd4341f488887fea0dd2e540/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:45:16.105881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe039-1908-4916-9a16-1e5352945a18 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.106290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe039-1908-4916-9a16-1e5352945a18 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.106618 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe039-1908-4916-9a16-1e5352945a18 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.108282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 397/771] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:16.114418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42028-a660-4a89-8cae-84e2e200745d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.114830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42028-a660-4a89-8cae-84e2e200745d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.115184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42028-a660-4a89-8cae-84e2e200745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.133133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-10e42028-a660-4a89-8cae-84e2e200745d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:16.134432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-10e42028-a660-4a89-8cae-84e2e200745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:16.207929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 398/772] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:16.210971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3e01-4741-4492-8e84-11411c324b17 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.230386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42028-a660-4a89-8cae-84e2e200745d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.277511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.278294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.278590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.279189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.279559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:16.279865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:16.281352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:16.292548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 375/773] 10.222.0.52 () {56 vars in 1124 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:16.298928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.352758 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42028-a660-4a89-8cae-84e2e200745d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.394387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.396166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.396737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.397224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.410377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:16.419917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:16.420901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:16.421749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:16.431285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 399/774] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:16.431285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.500033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152983e-562e-45b6-b002-c92641823ebc None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.537837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbc9a4-dfde-463d-970b-cdeb3049f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.538511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc9a4-dfde-463d-970b-cdeb3049f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.538783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc9a4-dfde-463d-970b-cdeb3049f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.539031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc9a4-dfde-463d-970b-cdeb3049f9e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.540022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbc9a4-dfde-463d-970b-cdeb3049f9e9 None admin] RBAC: Adding query filter params (interface=public, service_id=6810053d225542d294caa780496d3f0f, region_id=RegionOne) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:16.540227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbc9a4-dfde-463d-970b-cdeb3049f9e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:16.541516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbc9a4-dfde-463d-970b-cdeb3049f9e9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:16.549451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 376/775] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/endpoints?service_id=6810053d225542d294caa780496d3f0f&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:16.550739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c801-5e0a-4b01-a503-a68df083044d None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.551022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c801-5e0a-4b01-a503-a68df083044d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.551299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c801-5e0a-4b01-a503-a68df083044d None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.556970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 377/776] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:16.557726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c801-5e0a-4b01-a503-a68df083044d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.562487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a7627-f5f2-46a8-9df5-c83836fca3fe None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.605330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a352-382d-4e9f-8414-ecb2005f2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.606878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a352-382d-4e9f-8414-ecb2005f2d2e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.607378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a352-382d-4e9f-8414-ecb2005f2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.607862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a352-382d-4e9f-8414-ecb2005f2d2e None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.608858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a352-382d-4e9f-8414-ecb2005f2d2e None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:16.609794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a352-382d-4e9f-8414-ecb2005f2d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:16.611685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a352-382d-4e9f-8414-ecb2005f2d2e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:16.623549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 400/777] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:16.625297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6ffb-3ee6-4b16-b106-24b8a4838a71 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.625802 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6ffb-3ee6-4b16-b106-24b8a4838a71 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.626287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6ffb-3ee6-4b16-b106-24b8a4838a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.647603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2c8c6ffb-3ee6-4b16-b106-24b8a4838a71 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:16.649691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2c8c6ffb-3ee6-4b16-b106-24b8a4838a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:16.664936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c801-5e0a-4b01-a503-a68df083044d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.697362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.698420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.698953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.699340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.700299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:16.701755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:16.714457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 378/778] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:16.714457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.735062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 401/779] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:16.737210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8b76-bcab-4e78-9e8a-8a91c465c151 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.737210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8b76-bcab-4e78-9e8a-8a91c465c151 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.737534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8b76-bcab-4e78-9e8a-8a91c465c151 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.739018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 402/780] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:16.746512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424abbb-5603-4392-a5a7-0166b7c3cdb4 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.746940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424abbb-5603-4392-a5a7-0166b7c3cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.749357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424abbb-5603-4392-a5a7-0166b7c3cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.776463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-9424abbb-5603-4392-a5a7-0166b7c3cdb4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:16.777763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9424abbb-5603-4392-a5a7-0166b7c3cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:16.842403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abf7c3-5750-43e6-98a3-f74f7e76852b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:16.868835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 403/781] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:16.869789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424abbb-5603-4392-a5a7-0166b7c3cdb4 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.900038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:16.900892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:16.901171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:16.901448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:16.912790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:16.914313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:16.931982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:16.932968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:16.933870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:16.933870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:16.933870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:16.933870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:16.933870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 379/782] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:16.934642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:16.991312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424abbb-5603-4392-a5a7-0166b7c3cdb4 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.036289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.037279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.037867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.038149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] PATH_INFO: `/v3/services/network` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.039076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.041210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.042870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcb85-4c32-4e6c-8cc8-a934091956b2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:17.055874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:17.058303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:17.060471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 404/783] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:17.062442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.076317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.077256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.077540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.077803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.088345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:17.096088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:17.098356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 380/784] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:17.100436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.166931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b911-16ed-4431-b514-d987bd6f12fd None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.197915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4593504-0c09-4622-a3ab-ada566cb7358 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.200071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.200850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.201207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.201556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.202376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:17.202756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.204208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.216796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 405/785] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.217804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.235946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.236667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.236981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.237252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.238016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] RBAC: Adding query filter params (name=network) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:17.238316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.239731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.244668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 381/786] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.245542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.315314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7719-5ff8-42b4-a9e9-a7cd9be7e349 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.342161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc20f8d-21f7-4e63-a91e-43f20e42a6b3 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.348968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.349708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.349993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.350268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.351021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:17.351342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.352736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.364798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 406/787] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.365676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.375164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.375983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.376258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.376529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.384394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.386266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:17.400954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:17.403157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:17.405426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 382/788] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:17.412727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.465711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6e9a-41f9-42e7-a3b8-20eba601774a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.500468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.501203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.501484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.501754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.502479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] RBAC: Adding query filter params (type=network) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:17.502786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.504153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.507335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd405-177b-4fa3-9dd8-b0ffe8a8239b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.509470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 407/789] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.510777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.547428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.548235 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.548514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.548837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.560058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.561565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:17.582046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:17.584161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:17.586330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:17.586330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:17.586330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:17.586330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:17.586330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 383/790] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:17.586330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.618925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff739c7-72ef-48c7-8c28-9cf4909a5070 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.653379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.654063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.654346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.654625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.655476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:17.655784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.657267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.674661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 408/791] 10.222.0.52 () {56 vars in 1149 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.675591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.690890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42330ae-ed21-4884-96fc-6858a3491086 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.723637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.724228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.724504 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.724818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.725608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] RBAC: Adding query filter params (interface=public, service_id=cd18a281d22648f7a01f637ad44846c8, region_id=RegionOne) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:17.725920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.727339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.732846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 384/792] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/endpoints?service_id=cd18a281d22648f7a01f637ad44846c8&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.733635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.773157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12860c-f8f7-4714-944c-525f6dad2336 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.805645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.806337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.806616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.806892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.808360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:17.808707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.810101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.828310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 409/793] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.829258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.838120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3bd37-6b2f-44d9-8382-c8f732baf315 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.872645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.873873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.874394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.874896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.887471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.889454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:17.907924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:17.908930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:17.909834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:17.909834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:17.909834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:17.909834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:17.912132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 385/794] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:17.913175 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:17.935694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0d682-6f4d-4ac7-aa60-356ada9dc060 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:17.971491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:17.972089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:17.972371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:17.972647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:17.973461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:17.974789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:17.979933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 410/795] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:17.980845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.035864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5c787-2e9b-4202-8aa4-2acb635eca01 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.072581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.073944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.074436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.074967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.091757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60293213-eeaf-4d86-a912-b9446f5a2389 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.092797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.094549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:18.124273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:18.125334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:18.126363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:18.130261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 386/796] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:18.138133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.139946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.140652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.140966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.141245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.142009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:18.142319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.143743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.162047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 411/797] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:18.163491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.248433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9334d-afe1-40e9-961a-71576648b4ab None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.268289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94e32-2845-43dd-82ec-9f338ca44535 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.283793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.284839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.285332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.285857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.286906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:18.287422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.289110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.303735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.304516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.304832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.305108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.308302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 387/798] 10.222.0.52 () {56 vars in 1135 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:18.315905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.316073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.317619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:18.331550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:18.332493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:18.334095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:18.336786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 412/799] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:18.338735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.420507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60982d43-e3b4-48e7-964c-1e411ed8f7a3 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.440635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27262a-c93e-4302-a41c-3c9d82a7f16d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.467314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.468476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.469019 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.469517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.474870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.475544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.475824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.476098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.476942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:18.477256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.478690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.481981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.483715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.495821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 413/800] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:18.497253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:18.502556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:18.503516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:18.504412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:18.504412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:18.504412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:18.504412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:18.506979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 388/801] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:18.513540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.600294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9791e-286a-4d9d-b102-d20744070655 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.614655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed7702-7abc-4446-8cae-012f18094f12 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.634055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79ceb2-fb1d-426e-8573-213892010f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.635322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79ceb2-fb1d-426e-8573-213892010f19 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.635600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79ceb2-fb1d-426e-8573-213892010f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.635873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79ceb2-fb1d-426e-8573-213892010f19 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/d1455f40069444ffba21c84a8eab7e6f/roles/2ce8fc0880a947b3933dc0c970afe142` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.650670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79ceb2-fb1d-426e-8573-213892010f19 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=d1455f40069444ffba21c84a8eab7e6f, role_id=2ce8fc0880a947b3933dc0c970afe142)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.651128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.652101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.652214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79ceb2-fb1d-426e-8573-213892010f19 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.652736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.653238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.654161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:18.654681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.656376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.672736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 389/803] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:18.672945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 414/803] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:45:18 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/d1455f40069444ffba21c84a8eab7e6f/roles/2ce8fc0880a947b3933dc0c970afe142 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:45:18.675072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.711254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d68e-4b20-48c8-8851-5c67784a8843 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.711792 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d68e-4b20-48c8-8851-5c67784a8843 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.712071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d68e-4b20-48c8-8851-5c67784a8843 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.716834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 415/804] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:18.729811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fb8d7-1480-430f-b6cb-380ed1edee2a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.730039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fb8d7-1480-430f-b6cb-380ed1edee2a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.730311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fb8d7-1480-430f-b6cb-380ed1edee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.756714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-374fb8d7-1480-430f-b6cb-380ed1edee2a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:18.766523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-374fb8d7-1480-430f-b6cb-380ed1edee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:18.800165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c511ad-1566-49d3-84d2-cfe9b364773c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:18.836502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:18.837736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:18.838260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:18.838725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:18.846653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:18.849292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:18.864129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:18.865128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:18.866037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:18.868368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 390/805] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:18.873977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:18.926404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 416/806] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:18.968757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fb8d7-1480-430f-b6cb-380ed1edee2a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.007683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09816-eb69-49ec-a313-d546c2ad322a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.047162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.047834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.048113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.048390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.049215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:19.049525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:19.050961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:19.069916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 391/807] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:19.075633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.137398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fb8d7-1480-430f-b6cb-380ed1edee2a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.198609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef6b5-bda8-4f00-8283-31ec8962d073 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.218068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.219152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.219571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.220034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.233475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e723491-d28e-48fa-9e1f-9fcd25b728ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.234587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e723491-d28e-48fa-9e1f-9fcd25b728ea None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.234973 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e723491-d28e-48fa-9e1f-9fcd25b728ea None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.235343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e723491-d28e-48fa-9e1f-9fcd25b728ea None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/a9e110bec628462e8699b8681daf2d58/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.237462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e723491-d28e-48fa-9e1f-9fcd25b728ea None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=a9e110bec628462e8699b8681daf2d58, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:19.239021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e723491-d28e-48fa-9e1f-9fcd25b728ea None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:19.240285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:19.248607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:19.249725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:19.250576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:19.253261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 417/808] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:19.262545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 392/809] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:45:19 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/a9e110bec628462e8699b8681daf2d58/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:45:19.267945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.333297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4c91-4c47-4bac-8fcf-2794242f3974 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.333297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4c91-4c47-4bac-8fcf-2794242f3974 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.333616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4c91-4c47-4bac-8fcf-2794242f3974 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.335295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 393/810] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:19.340872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3968-8e12-4489-8397-e99a89d94562 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.341156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3968-8e12-4489-8397-e99a89d94562 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.341432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3968-8e12-4489-8397-e99a89d94562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.358775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5e1d3968-8e12-4489-8397-e99a89d94562 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:19.359994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5e1d3968-8e12-4489-8397-e99a89d94562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:19.395824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c794ed-79c3-4494-a844-81bac2a3cce3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.438250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.439237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.439666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.440085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.441036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:19.441534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:19.443135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:19.459450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 418/811] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:19.466355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.477697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 394/812] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:19.502391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d3968-8e12-4489-8397-e99a89d94562 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.579187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcbd4c-9606-40d7-9c34-deb620d53cef None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.624453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.625555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.626001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.626421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.650995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d3968-8e12-4489-8397-e99a89d94562 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.652411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:19.654125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:19.683710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:19.685018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:19.686124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:19.686124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:19.686124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:19.686124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:19.698129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 419/813] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:19.704127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.731847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.732718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.733042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.733318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.733986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:19.735356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:19.747628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:19.748613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:19.749502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 395/814] 10.222.0.52 () {56 vars in 1129 bytes} [Tue May 10 18:45:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:19.754917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.826841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef905c-292f-4240-9e6b-b66eb1ac83d2 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.873102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.874241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.874815 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.875299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.876267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:19.876837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:19.878423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:19.896269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 420/815] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:19.902248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:19.931551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7922a-a959-4b5b-a954-6f1cc851fa5b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:19.971159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:19.973320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:19.975085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:19.975597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:19.976531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:19.978600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:19.980196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:19.991900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 396/816] 10.222.0.52 () {56 vars in 1124 bytes} [Tue May 10 18:45:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:19.995331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:20.094819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ee60b-bea7-4edc-8c12-b0eecfb2b0fb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:20.136090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:20.137547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:20.140175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:20.140725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:20.159393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:20.161251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:20.190183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:20.191322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:20.192272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:20.195941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 421/817] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:45:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:20.201337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:20.218792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6447-3124-4c17-b9e3-1fc8cd5dbdd2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:20.309492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:20.310196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:20.310490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:20.310834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:20.311728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:20.312243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:20.313574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985557-2139-4e92-a071-1d592d6b1785 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:20.313892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:20.331276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 397/818] 10.222.0.52 () {56 vars in 1124 bytes} [Tue May 10 18:45:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:20.336307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:20.357167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:20.359632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:20.359911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:20.361543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:20.362931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:20.363249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:20.367027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:20.395951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 422/819] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:45:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:20.402136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:20.521559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786c32-0a7d-4ba0-a90a-5ac296c7b487 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:20.587784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:20.588663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:20.588963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:20.589246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:20.589988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:20.591453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:20.594422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbde0-ed6e-4980-b757-c22e23a4c669 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:20.635865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 398/820] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:20.662265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4ba9-b08b-42be-bcf8-f86b8cdb7876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:20.662900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4ba9-b08b-42be-bcf8-f86b8cdb7876 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:20.663179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4ba9-b08b-42be-bcf8-f86b8cdb7876 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:20.663454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4ba9-b08b-42be-bcf8-f86b8cdb7876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:20.756538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e4ba9-b08b-42be-bcf8-f86b8cdb7876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:20.758078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e4ba9-b08b-42be-bcf8-f86b8cdb7876 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:20.871928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 423/821] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:45:20.878142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:20.966757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb0290-9cc6-46e1-b3d0-5fff7f7c3360 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:20.966967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb0290-9cc6-46e1-b3d0-5fff7f7c3360 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:20.967218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb0290-9cc6-46e1-b3d0-5fff7f7c3360 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:20.968896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 424/822] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:20.979548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a0a13-f995-43af-aa44-419d06d6c650 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:20.979862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a0a13-f995-43af-aa44-419d06d6c650 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:20.980129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a0a13-f995-43af-aa44-419d06d6c650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.001714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-585a0a13-f995-43af-aa44-419d06d6c650 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:21.003266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-585a0a13-f995-43af-aa44-419d06d6c650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:21.010904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b59213-6177-43cf-8c7d-0636f89958e4 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.051544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.052372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.052657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.053050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.064362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.065768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.073349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 425/823] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:21.085770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:21.086692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:21.087585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:21.087585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:21.087585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:21.087585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:21.087585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 399/824] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:21.093039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a0a13-f995-43af-aa44-419d06d6c650 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.107037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.236190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab380b85-90bb-471a-97d0-e8fbb2323615 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.239995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a0a13-f995-43af-aa44-419d06d6c650 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.277104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.277963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.278249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.278527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] PATH_INFO: `/v3/services/network` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.279197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.280582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.281636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.282314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.282590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.282866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.283609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:21.283920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.285309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.304724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 426/825] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:21.306434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:21.308095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:21.309227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 18:45:21.310068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:21.317119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 400/826] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:21.319900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.424310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0335d18-7f37-4fd8-8e7c-38e45df69978 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.463814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.464867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.465549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.466026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.466956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] RBAC: Adding query filter params (name=network) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:21.467481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.469227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.474664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 401/827] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:21.481509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.526221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12817b7d-7bfe-47fc-8b8b-15564f4bf6a1 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.567707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b554a-5497-45dd-a809-f740358103dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.568862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b554a-5497-45dd-a809-f740358103dc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.569151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b554a-5497-45dd-a809-f740358103dc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.569424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b554a-5497-45dd-a809-f740358103dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.578544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b554a-5497-45dd-a809-f740358103dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.580724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b554a-5497-45dd-a809-f740358103dc None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-271b554a-5497-45dd-a809-f740358103dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:21.600570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:21.601645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:21.602529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:21.604748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 427/828] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:21.606741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1253-692a-4ac9-932d-c58b857f1c7e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.607943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1253-692a-4ac9-932d-c58b857f1c7e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.608223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1253-692a-4ac9-932d-c58b857f1c7e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.609583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 428/829] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:21.610276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e1253-692a-4ac9-932d-c58b857f1c7e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.615552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70763d6e-1b96-44ec-a4be-7a0a8b4abaa7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.652923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326789e-f622-4e8d-8a84-35940a0b9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.653987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326789e-f622-4e8d-8a84-35940a0b9a74 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.654465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326789e-f622-4e8d-8a84-35940a0b9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.654935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326789e-f622-4e8d-8a84-35940a0b9a74 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.655865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326789e-f622-4e8d-8a84-35940a0b9a74 None admin] RBAC: Adding query filter params (type=network) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:21.656365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326789e-f622-4e8d-8a84-35940a0b9a74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.657966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326789e-f622-4e8d-8a84-35940a0b9a74 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.664149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 402/830] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:21.665693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e12f2e-ee29-470b-aea5-e298c0900ec7 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.666210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e12f2e-ee29-470b-aea5-e298c0900ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.666680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e12f2e-ee29-470b-aea5-e298c0900ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.683094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d3e12f2e-ee29-470b-aea5-e298c0900ec7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:21.684647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d3e12f2e-ee29-470b-aea5-e298c0900ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:21.717060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e1253-692a-4ac9-932d-c58b857f1c7e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.756824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 403/831] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:21.756824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e12f2e-ee29-470b-aea5-e298c0900ec7 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.758269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade9891-4e40-4d3e-b0f2-8d7a83c394f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.758269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade9891-4e40-4d3e-b0f2-8d7a83c394f5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.758477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade9891-4e40-4d3e-b0f2-8d7a83c394f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.758847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade9891-4e40-4d3e-b0f2-8d7a83c394f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.759562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade9891-4e40-4d3e-b0f2-8d7a83c394f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:21.760231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade9891-4e40-4d3e-b0f2-8d7a83c394f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.761711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade9891-4e40-4d3e-b0f2-8d7a83c394f5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.773770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 429/832] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:21.775012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917e791-633e-4c61-85dc-441b172f459f None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.775290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917e791-633e-4c61-85dc-441b172f459f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.775570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917e791-633e-4c61-85dc-441b172f459f None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.777002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 430/833] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:21.782379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d95d74-f8de-4bbf-95c9-b51dab532878 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.782674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d95d74-f8de-4bbf-95c9-b51dab532878 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.782975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d95d74-f8de-4bbf-95c9-b51dab532878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.800626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-31d95d74-f8de-4bbf-95c9-b51dab532878 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:21.801857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-31d95d74-f8de-4bbf-95c9-b51dab532878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:21.858293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e12f2e-ee29-470b-aea5-e298c0900ec7 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:21.876703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 431/834] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:21.876703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d95d74-f8de-4bbf-95c9-b51dab532878 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.904499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:21.905213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:21.905498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:21.905774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:21.906521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:21.907905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:21.936719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 404/835] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:21.936719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:21.986863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d95d74-f8de-4bbf-95c9-b51dab532878 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.034670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.035383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.035902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.036390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.037427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=dff69f29cd4341f488887fea0dd2e540) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:22.037820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.040134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.055747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 432/836] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/role_assignments?user.id=dff69f29cd4341f488887fea0dd2e540&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:22.055747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.080112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f77b12-0248-4692-ab72-89cd669dd8b3 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.153624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.154540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.154827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.155156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.173606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:22.181460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:22.182459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:22.183760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 405/837] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:22.193772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.228507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193641-50df-47a2-9ada-d767f4f76875 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.273128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.273943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.274226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.274503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.287126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:22.294893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:22.295902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:22.297167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 433/838] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:22.302613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.333403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07894fc1-993c-4e8e-bbf2-bb050278ef93 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.373550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.374244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.374525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.375517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.375660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:22.375862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.377337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.386899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 406/839] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:22.396716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.420423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d15ed8-bc9f-4aad-8dbd-6090ea7d9bd0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.464391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.465446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.465933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.466440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.467409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:22.467916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.469521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.478412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 434/840] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:22.484130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.510362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03952a-c0e2-4240-8c83-f2415a57d724 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.544384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.545220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.545403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.545733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.556460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.557940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:22.575012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:22.575974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:22.576921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:22.576921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:22.576921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:22.576921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:22.582134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 407/841] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:22.582598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.593534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d575fdd-9be2-4fb8-bb2b-b78025e9aaa8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.635228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.636054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.636381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.636653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.650212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.651842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:22.675106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:22.676072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:22.677041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:22.677041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:22.677041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:22.677041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:22.682131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 435/842] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:22.682661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.701171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b70e4f-5f7a-4981-96e0-874c13c44efa None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.736055 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.736936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.737126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.737370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.738153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:22.738473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.739861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.757855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 408/843] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:22.758895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.813389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4a6a-df88-4805-9a97-758167fd3b12 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.849368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.850105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.850391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.850761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.851777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:22.851889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.853340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.870081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 436/844] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:22.871405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.877962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6bb1d-affe-4c09-b492-498fa7ce3eea None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:22.920029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:22.921634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:22.921929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:22.922211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:22.929846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:22.931339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:22.946305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:22.947299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:22.948626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 409/845] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:22.953187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:22.988100 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155d1c-94e4-4d90-91b8-e127632eb7c0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.023573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.024488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.024895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.025269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] PATH_INFO: `/v3/users/swift` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.032728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.034275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:23.048801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:23.049992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 18:45:23.051158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:23.052990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 437/846] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:23.064843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.072399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430376-5c2c-4f51-87e0-e24a3c23c9e2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.108889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.109719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.110062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.110403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.111331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:23.111707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.113314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.132083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 410/847] 10.222.0.52 () {56 vars in 1149 bytes} [Tue May 10 18:45:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:23.138188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.166960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca7a31-245c-4b08-9d49-e5d158ab8eeb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.201234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.201918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.202203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.202476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.203335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:23.203637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.205124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.227365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 438/848] 10.222.0.52 () {56 vars in 1135 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:23.228483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.242480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57ff91-305c-4a24-86a6-c09d6790268e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.276560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25a551-185b-4f85-8706-3c32e674292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.277355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a551-185b-4f85-8706-3c32e674292c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.277714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a551-185b-4f85-8706-3c32e674292c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.277995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a551-185b-4f85-8706-3c32e674292c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.335811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3192-86f6-45e7-b882-5bfb3b2142df None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.349266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25a551-185b-4f85-8706-3c32e674292c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.351184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25a551-185b-4f85-8706-3c32e674292c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.370796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c497a-9a80-4d48-84b7-3b38684e10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.372070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c497a-9a80-4d48-84b7-3b38684e10d2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.372533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c497a-9a80-4d48-84b7-3b38684e10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.373023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c497a-9a80-4d48-84b7-3b38684e10d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.455806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 411/849] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:45:23.455806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcb6e0-e526-4a6a-a584-e4b8649bb5fb None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.455806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcb6e0-e526-4a6a-a584-e4b8649bb5fb None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.455806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcb6e0-e526-4a6a-a584-e4b8649bb5fb None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.455806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 412/850] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:23.459082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c497a-9a80-4d48-84b7-3b38684e10d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.459699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcb6e0-e526-4a6a-a584-e4b8649bb5fb None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.460623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c497a-9a80-4d48-84b7-3b38684e10d2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.556245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 439/851] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:45:23.556446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcb6e0-e526-4a6a-a584-e4b8649bb5fb None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.558058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516cdee-4f74-448b-a007-69e59df7cd29 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.558558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516cdee-4f74-448b-a007-69e59df7cd29 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.559078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516cdee-4f74-448b-a007-69e59df7cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.575023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e516cdee-4f74-448b-a007-69e59df7cd29 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:23.576315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e516cdee-4f74-448b-a007-69e59df7cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:23.592940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.593687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.593961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.594227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.604115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.605599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:23.622889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:23.624425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:23.626308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:23.626308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:23.626308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:23.626308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:23.626308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 413/852] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:23.630921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.647002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 440/853] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:23.648451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516cdee-4f74-448b-a007-69e59df7cd29 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.742440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516cdee-4f74-448b-a007-69e59df7cd29 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.744241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32973-bf49-4afd-a2e8-2e9cc8809c66 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.774783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.775460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.775743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.776020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.776780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:23.777088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.777294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.778153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.778431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.778536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.778701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.789282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.789520 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 441/854] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:23.790298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.791554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:23.814417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:23.815357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:23.816260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:23.816260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:23.816260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:23.816260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:23.818390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 414/855] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:23.819905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.889171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756369-de63-4d69-a7d2-32a418cc050b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.916529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08669d6-8d58-4ef9-aecd-fddad330b19f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:23.921451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.922271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.922553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.922829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.923493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.924919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:23.936868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:23.937881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:23.938719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 442/856] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:23.939521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:23.955303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:23.956112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:23.956390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:23.956656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:23.963455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:23.964927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:23.978477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:23.979528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:23.980482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 415/857] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:23.981061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.056125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25f3d4-34e3-457b-977d-ca5e980d9f0d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.081775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652bf5-1be5-43df-b3ce-29d6e3a75c15 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.091136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.091808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.092088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.092356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.093105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.093413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.094787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.110472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 443/858] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:24.110472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.119369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.120148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.120501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.120866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.121737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.122104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.123559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.128277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 416/859] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:24.129057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.208045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa78e2-6bd0-442c-9a95-66ee413e2e0c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.224484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c052-c948-4573-b7fc-e7be0fae5199 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.243828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.244513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.244817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.245084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.245891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.246199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.247817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.261221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 444/860] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:24.261701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.262153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.263029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.263509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.263982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.273025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.274489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:24.288525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:24.289597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:24.290708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:24.294751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 417/861] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:24.295588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.368822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfcb64-133a-433f-8150-699fd59b8918 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.389577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48084b90-7875-4b8a-bcfa-9ca0d367df7d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.402823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.403502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.403787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.404062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.404805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.405119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.406585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.410934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 445/862] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:24.411862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.422369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b58b-6595-4fbb-b1ec-acd8a16e7101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.423084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b58b-6595-4fbb-b1ec-acd8a16e7101 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.423337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b58b-6595-4fbb-b1ec-acd8a16e7101 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.423611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b58b-6595-4fbb-b1ec-acd8a16e7101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.424463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b58b-6595-4fbb-b1ec-acd8a16e7101 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=d1455f40069444ffba21c84a8eab7e6f) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.424809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b58b-6595-4fbb-b1ec-acd8a16e7101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.428729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b58b-6595-4fbb-b1ec-acd8a16e7101 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.433223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 418/863] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/role_assignments?user.id=d1455f40069444ffba21c84a8eab7e6f&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:24.434612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3efe9d-9d19-4155-ac76-c2fe2cab4a02 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.434896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3efe9d-9d19-4155-ac76-c2fe2cab4a02 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.435169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3efe9d-9d19-4155-ac76-c2fe2cab4a02 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.436757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 419/864] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:24.442742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a29f-de36-4f1a-99ae-baf5ec42c5b4 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.443036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a29f-de36-4f1a-99ae-baf5ec42c5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.443332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a29f-de36-4f1a-99ae-baf5ec42c5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.467355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8153a29f-de36-4f1a-99ae-baf5ec42c5b4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:24.469209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8153a29f-de36-4f1a-99ae-baf5ec42c5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:24.542468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335651e7-a4a7-49da-ae7a-482908236deb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.553208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 420/865] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:24.569565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153a29f-de36-4f1a-99ae-baf5ec42c5b4 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.581754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.582499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.582788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.583365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.583900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.584216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.586701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.602398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 446/866] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:24.609011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.679509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153a29f-de36-4f1a-99ae-baf5ec42c5b4 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.720740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.721523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.721793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.722067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.722731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.723674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650299-b279-464d-931f-7793f11fb58f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.724109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:24.737439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:24.738426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:24.739262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 421/867] 10.222.0.52 () {56 vars in 1132 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:24.745121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:24.759302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.760231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.760509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.760806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.761636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=a9e110bec628462e8699b8681daf2d58) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.761993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.764099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.771947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 447/868] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/role_assignments?user.id=a9e110bec628462e8699b8681daf2d58&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:24.862557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7806b73-fe5a-4fa9-a4ea-ae848d261626 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:24.899363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c9267-faf2-43b4-8acc-6b9c6ac4350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:24.900069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c9267-faf2-43b4-8acc-6b9c6ac4350d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:24.900344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c9267-faf2-43b4-8acc-6b9c6ac4350d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:24.900616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c9267-faf2-43b4-8acc-6b9c6ac4350d None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:24.901384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c9267-faf2-43b4-8acc-6b9c6ac4350d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:24.901686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c9267-faf2-43b4-8acc-6b9c6ac4350d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:24.903589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c9267-faf2-43b4-8acc-6b9c6ac4350d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:24.909356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 422/869] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:24.915448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:25.026114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c63a3-7d8f-45ce-855a-950844faeb30 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:25.059434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d823518-6083-4f86-a3e9-9a9681060f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:25.060468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823518-6083-4f86-a3e9-9a9681060f55 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:25.061004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823518-6083-4f86-a3e9-9a9681060f55 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:25.061479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823518-6083-4f86-a3e9-9a9681060f55 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:25.062412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823518-6083-4f86-a3e9-9a9681060f55 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:25.062917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823518-6083-4f86-a3e9-9a9681060f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:25.064474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823518-6083-4f86-a3e9-9a9681060f55 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:25.069664 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 448/870] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:26.682616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f258dc-8c70-4972-9843-a87dae4f6633 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:26.683141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f258dc-8c70-4972-9843-a87dae4f6633 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:26.683141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f258dc-8c70-4972-9843-a87dae4f6633 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:26.684916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 423/871] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:26.690521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a553e-7902-4d10-acda-cca6a4871c99 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:26.690964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a553e-7902-4d10-acda-cca6a4871c99 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:26.691148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a553e-7902-4d10-acda-cca6a4871c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:26.708535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-541a553e-7902-4d10-acda-cca6a4871c99 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:26.709679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-541a553e-7902-4d10-acda-cca6a4871c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:26.776552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 449/872] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:26.799167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f258dc-8c70-4972-9843-a87dae4f6633 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:26.861320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc949f33-825a-440d-b133-4dd7e12ff778 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:26.861678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc949f33-825a-440d-b133-4dd7e12ff778 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:26.861878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc949f33-825a-440d-b133-4dd7e12ff778 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:26.863695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 450/873] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:26.873694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a14514-6b39-4933-86bb-3d2296db8597 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:26.874019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a14514-6b39-4933-86bb-3d2296db8597 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:26.874255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a14514-6b39-4933-86bb-3d2296db8597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:26.892410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e6a14514-6b39-4933-86bb-3d2296db8597 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:26.893670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e6a14514-6b39-4933-86bb-3d2296db8597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:26.909818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f258dc-8c70-4972-9843-a87dae4f6633 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:26.945473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:26.946154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:26.946429 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:26.946700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:26.947432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:26.948821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:26.964453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 424/874] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:26 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:26.964911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 451/875] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:26.993293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.058047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd4e4-026f-4243-957a-cdfd3ee08921 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.058798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd4e4-026f-4243-957a-cdfd3ee08921 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.058979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd4e4-026f-4243-957a-cdfd3ee08921 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.061348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 452/876] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:27.068312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52a83-1b8d-4ca0-a74b-0a20167a8174 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.068634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52a83-1b8d-4ca0-a74b-0a20167a8174 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.069041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52a83-1b8d-4ca0-a74b-0a20167a8174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.089368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c0b52a83-1b8d-4ca0-a74b-0a20167a8174 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:27.091351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c0b52a83-1b8d-4ca0-a74b-0a20167a8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:27.119513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f0395-c6f9-4bbe-9645-7b4d17ade46f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.167559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.168537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.168904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.169173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.179306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 453/877] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:27.181373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:27.189712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:27.191023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:27.192072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:27.192949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 425/878] 10.222.0.52 () {56 vars in 1120 bytes} [Tue May 10 18:45:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:27.197250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52a83-1b8d-4ca0-a74b-0a20167a8174 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.201544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.303449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e762f-dbbe-4662-a3f4-c6ed7909eb2c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.317622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52a83-1b8d-4ca0-a74b-0a20167a8174 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.338867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192c5df-1e36-4cd3-9227-4a73e116261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.339687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c5df-1e36-4cd3-9227-4a73e116261b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.340013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c5df-1e36-4cd3-9227-4a73e116261b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.340285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c5df-1e36-4cd3-9227-4a73e116261b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.340977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192c5df-1e36-4cd3-9227-4a73e116261b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:27.342354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192c5df-1e36-4cd3-9227-4a73e116261b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c192c5df-1e36-4cd3-9227-4a73e116261b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:27.354480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:27.358283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:27.365495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:27.366396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e58e8e-af29-4c65-a89e-967d5e209038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.366396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e58e8e-af29-4c65-a89e-967d5e209038 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.366396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e58e8e-af29-4c65-a89e-967d5e209038 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.366396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e58e8e-af29-4c65-a89e-967d5e209038 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.366706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 426/879] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:27.366706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f171b-d4a3-410b-8f0f-7ff3cd5187c5 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.366706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f171b-d4a3-410b-8f0f-7ff3cd5187c5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.366706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f171b-d4a3-410b-8f0f-7ff3cd5187c5 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.366706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 427/880] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:27.367080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e58e8e-af29-4c65-a89e-967d5e209038 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:27.367163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f171b-d4a3-410b-8f0f-7ff3cd5187c5 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.367243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e58e8e-af29-4c65-a89e-967d5e209038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:27.367243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e58e8e-af29-4c65-a89e-967d5e209038 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:27.374537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 454/881] 10.222.0.52 () {56 vars in 1115 bytes} [Tue May 10 18:45:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:27.375810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a133-e3f5-4701-bc7d-72c84ad4210a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.376098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a133-e3f5-4701-bc7d-72c84ad4210a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.376423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a133-e3f5-4701-bc7d-72c84ad4210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.394822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-12c2a133-e3f5-4701-bc7d-72c84ad4210a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:27.396014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-12c2a133-e3f5-4701-bc7d-72c84ad4210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:27.480704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 455/882] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:27.480704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2a133-e3f5-4701-bc7d-72c84ad4210a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.480948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f171b-d4a3-410b-8f0f-7ff3cd5187c5 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.515425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.516102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.516785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.517087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.517810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:27.518116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:27.520148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:27.530474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 428/883] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:27.530474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.573159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2a133-e3f5-4701-bc7d-72c84ad4210a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.606316 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.607127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.607408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.607691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.620939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:27.622457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:27.637442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9d7b-ac14-4d79-8a8a-1ecdfa81d757 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:27.640179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:27.641118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:27.646536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:27.646536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:27.646536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:27.646536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:27.646536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 456/884] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:27.646536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.674200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.674978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.675194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.675540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.676187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:27.677597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:27.691524 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 429/885] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:27 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:27.697793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.748178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f8f4-e9b3-4d28-84fe-2f70bdc4ad19 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.791550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.792386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.792796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.793221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.794176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:27.794480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:27.796054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:27.806864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 457/886] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:27.821109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0237e5-d950-4080-9a9d-a6948c4d9c6f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:27.861886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:27.862581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:27.862861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:27.863135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:27.863905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:27.864193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:27.865679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:27.880454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 430/887] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:27.886479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:27.999045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0a5f-4526-4e7c-9522-9298167c772b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:28.040357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:28.041574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:28.042078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:28.042554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:28.053264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:28.055041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:28.070917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:28.071903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:28.072885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:28.075643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 458/888] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:45:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:28.084708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:28.186611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650de6db-8ebd-456c-9c4d-e7e5c239a6b7 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:28.220750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:28.221434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:28.221714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:28.221992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:28.222835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:28.223141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:28.224572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:28.242250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 431/889] 10.222.0.52 () {56 vars in 1149 bytes} [Tue May 10 18:45:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:28.247721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:28.349051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244eee8-6234-4368-bc4d-d7c566303fa1 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:28.383893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:28.384981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:28.385265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:28.385539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:28.452884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:28.454344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:28.553290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 459/890] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:45:28.558857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:28.659056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b38d5-0f94-4b93-81e5-a8ff50a6abf6 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:28.692465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:28.693304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:28.693583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:28.693854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:28.703977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:28.705388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:28.722893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:28.723842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:28.725025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:28.725025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:28.725025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:28.725025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:28.725025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 432/891] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:28.729809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:28.825966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20108613-3b62-44ff-b82e-4b03033c5af8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:28.858653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:28.859332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:28.859593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:28.859865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:28.860596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:28.860989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:28.862285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:28.873872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 460/892] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:28.879372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:28.981184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1ea01-e322-4aa3-a6da-ae4a36bd4839 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:29.016150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:29.017215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.017494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.017765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.025786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:29.027317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:29.041603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:29.043835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:29.046048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 433/893] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:29.052700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:29.153748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9186d-a4bc-4dd3-a108-6717e82915a0 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:29.186608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71950-a9e8-4d9d-a312-6ec6a6aaecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:29.187274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71950-a9e8-4d9d-a312-6ec6a6aaecfa None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.187555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71950-a9e8-4d9d-a312-6ec6a6aaecfa None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.187831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71950-a9e8-4d9d-a312-6ec6a6aaecfa None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.188609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71950-a9e8-4d9d-a312-6ec6a6aaecfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:29.188949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71950-a9e8-4d9d-a312-6ec6a6aaecfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:29.190360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71950-a9e8-4d9d-a312-6ec6a6aaecfa None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:29.202755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 461/894] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:29.208684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:29.287493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eb369-1456-434c-8f4e-b7cdb7f53890 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.287668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eb369-1456-434c-8f4e-b7cdb7f53890 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.287945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eb369-1456-434c-8f4e-b7cdb7f53890 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.289594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 462/895] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:29.298753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f04f-5333-4063-a0cf-3072bfd93a54 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.299255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f04f-5333-4063-a0cf-3072bfd93a54 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.299727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f04f-5333-4063-a0cf-3072bfd93a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.315088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c588c5-d71f-471e-a0f0-a83e21d68d39 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:29.316628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-46a8f04f-5333-4063-a0cf-3072bfd93a54 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:29.318063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-46a8f04f-5333-4063-a0cf-3072bfd93a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:29.354262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:29.354919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.355196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.355494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.356328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] RBAC: Adding query filter params (role.id=3dbd4cd0a19d4aaea323abe322569413, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=d1455f40069444ffba21c84a8eab7e6f) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:29.356637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:29.358505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:29.366016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 434/896] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:29 2022] GET /identity/v3/role_assignments?user.id=d1455f40069444ffba21c84a8eab7e6f&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=3dbd4cd0a19d4aaea323abe322569413 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:29.388603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 463/897] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:29.412442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:29.523667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ead58-9e5b-4b0b-b20f-5c8b4f3e3dfa None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:29.560298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:29.561099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.561381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.561657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.562340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:29.563734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:29.576304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:29.577345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:29.578171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:29.582885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 435/898] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:29.583943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f04f-5333-4063-a0cf-3072bfd93a54 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:29.681001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f04f-5333-4063-a0cf-3072bfd93a54 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:29.715033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:29.716084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.716560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.717085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.717985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:29.718484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:29.720060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:29.725492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 464/899] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:29.736712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:29.838128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec8f31-5933-47fc-8be9-d424d860fafa None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:29.872444 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:29.873405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:29.873829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:29.874272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:29.875132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:29.875580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:29.877130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:29.883036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 436/900] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:29.889962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:29.996380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0d5d-ffcb-44bd-ac57-5c8ddf0dbbe4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:30.033584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88cf50-5e2b-42e8-b844-3fc4583929f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:30.034255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88cf50-5e2b-42e8-b844-3fc4583929f0 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.034536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88cf50-5e2b-42e8-b844-3fc4583929f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.034810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88cf50-5e2b-42e8-b844-3fc4583929f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.035616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88cf50-5e2b-42e8-b844-3fc4583929f0 None admin] RBAC: Adding query filter params (interface=public, service_id=387e94012d684533ae0e78b359aca82f, region_id=RegionOne) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:30.035982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88cf50-5e2b-42e8-b844-3fc4583929f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:30.037409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88cf50-5e2b-42e8-b844-3fc4583929f0 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:30.045425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 465/901] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:45:29 2022] GET /identity/v3/endpoints?service_id=387e94012d684533ae0e78b359aca82f&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:30.050905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:30.084630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fe88-e9ec-4c96-b706-596a837fc9a4 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.084979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fe88-e9ec-4c96-b706-596a837fc9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.085225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fe88-e9ec-4c96-b706-596a837fc9a4 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.090659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 466/902] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:30.092215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38d25-67a0-428a-a93e-46c835041062 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.092402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38d25-67a0-428a-a93e-46c835041062 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.092731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38d25-67a0-428a-a93e-46c835041062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.110275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5fa38d25-67a0-428a-a93e-46c835041062 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:30.111951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5fa38d25-67a0-428a-a93e-46c835041062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:30.153803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40d8e-487f-4f35-a15f-997129d969a1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:30.183016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 467/903] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:30.184841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde21547-6cc3-4e57-8f1f-d5f6486e85b8 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.185323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde21547-6cc3-4e57-8f1f-d5f6486e85b8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.185790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde21547-6cc3-4e57-8f1f-d5f6486e85b8 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.186781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:30.187460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.191764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.191764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.191764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:30.191764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:30.192268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 468/904] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:30.193607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b14c60-39e0-4a51-bfa2-600d7e1418d8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.194060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b14c60-39e0-4a51-bfa2-600d7e1418d8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.194502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b14c60-39e0-4a51-bfa2-600d7e1418d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.197226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 437/905] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:30 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:45:30.210327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:30.215328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a6b14c60-39e0-4a51-bfa2-600d7e1418d8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:30.216569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a6b14c60-39e0-4a51-bfa2-600d7e1418d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:30.288722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 469/906] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:30.311015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b14c60-39e0-4a51-bfa2-600d7e1418d8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:30.345545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086056d-6c2b-490d-902c-6d22e0a8fd6a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:30.395327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:30.396547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.396925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.397271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.398906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:30.400347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:30.416432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:30.417606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:30.418736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 438/907] 10.222.0.52 () {56 vars in 1132 bytes} [Tue May 10 18:45:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:30.423752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:30.441470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b14c60-39e0-4a51-bfa2-600d7e1418d8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:30.486292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:30.486970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.487249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.487523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.488244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:30.489716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:30.508817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 470/908] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:30 2022] POST /identity/v3/services => generated 241 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:30.549443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41fbc-0bbe-4808-a35f-cc40cbefe042 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:30.596288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:30.597035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.597317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.597589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.598412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:30.598719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:30.600212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:30.606196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 439/909] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:30.611577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:30.718535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a7b7-4946-453f-a6f0-2deae3c35da6 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:30.751484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:30.752161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.752435 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.752730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.753451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:30.753755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:30.755108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:30.760603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 471/910] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:30.766560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:30.872261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7cd1b-aaf2-497d-a586-c5678fc0c86e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:30.910660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aab8a2-84b3-4c3c-aadb-5e4e75162c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:30.911334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aab8a2-84b3-4c3c-aadb-5e4e75162c17 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:30.911720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aab8a2-84b3-4c3c-aadb-5e4e75162c17 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:30.912003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aab8a2-84b3-4c3c-aadb-5e4e75162c17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:30.912835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aab8a2-84b3-4c3c-aadb-5e4e75162c17 None admin] RBAC: Adding query filter params (interface=public, service_id=4ea59e7585b343e7b865a73b1f481fdd, region_id=RegionOne) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:30.913158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aab8a2-84b3-4c3c-aadb-5e4e75162c17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:30.914529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aab8a2-84b3-4c3c-aadb-5e4e75162c17 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:30.920059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 440/911] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:45:30 2022] GET /identity/v3/endpoints?service_id=4ea59e7585b343e7b865a73b1f481fdd&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:30.925464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:31.028493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4446a-0af9-478e-9ff4-e9a39d057b34 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:31.062733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700342f-9074-4976-967e-0587c840abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:31.063413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700342f-9074-4976-967e-0587c840abe9 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:31.063691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700342f-9074-4976-967e-0587c840abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:31.063960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700342f-9074-4976-967e-0587c840abe9 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:31.064647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700342f-9074-4976-967e-0587c840abe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:31.066050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700342f-9074-4976-967e-0587c840abe9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:31.072406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 472/912] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:30 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:45:31.658121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d86e2-fc99-43b6-86a8-98f0984d1af0 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:31.658520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d86e2-fc99-43b6-86a8-98f0984d1af0 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:31.658693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d86e2-fc99-43b6-86a8-98f0984d1af0 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:31.660341 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 441/913] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:31.665512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede5bf-54d2-4aa8-9c84-dd2aa102fd79 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:31.665805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede5bf-54d2-4aa8-9c84-dd2aa102fd79 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:31.666084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede5bf-54d2-4aa8-9c84-dd2aa102fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:31.682801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-23ede5bf-54d2-4aa8-9c84-dd2aa102fd79 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:31.684048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-23ede5bf-54d2-4aa8-9c84-dd2aa102fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:31.751322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 473/914] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:31.773913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d86e2-fc99-43b6-86a8-98f0984d1af0 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:31.875028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d86e2-fc99-43b6-86a8-98f0984d1af0 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:31.909041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:31.909865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:31.910145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:31.910418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:31.921972 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:31.930017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:31.932083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:31.934151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 442/915] 10.222.0.52 () {56 vars in 1120 bytes} [Tue May 10 18:45:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:31.942035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede5bf-54d2-4aa8-9c84-dd2aa102fd79 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.036220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede5bf-54d2-4aa8-9c84-dd2aa102fd79 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.069587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:32.070260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.070537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.070813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.071566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:32.071870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:32.073263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:32.081462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 474/916] 10.222.0.52 () {56 vars in 1115 bytes} [Tue May 10 18:45:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:32.087180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.184492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7870ac-3e7c-4628-a519-3efc1f61a108 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.220176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:32.221017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.221298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.221571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.231771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:32.233249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:32.250888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:32.252992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:32.255054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:32.255054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:32.255054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:32.255054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:32.255054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 443/917] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:32.258313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.361312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30038-1b27-41c0-954e-9b175aec1607 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.398414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe39b5-011d-4aa6-be22-f176fd2e52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:32.399093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe39b5-011d-4aa6-be22-f176fd2e52e4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.399374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe39b5-011d-4aa6-be22-f176fd2e52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.399646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe39b5-011d-4aa6-be22-f176fd2e52e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.400383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe39b5-011d-4aa6-be22-f176fd2e52e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:32.400702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe39b5-011d-4aa6-be22-f176fd2e52e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:32.402082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe39b5-011d-4aa6-be22-f176fd2e52e4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:32.414479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 475/918] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:32.419768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.518031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade4845-9215-4bc2-89f8-2f95018bedde None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.550997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:32.551816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.552097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.552368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.560035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:32.561564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:32.565527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42169049-37f9-42ad-a8ac-4fd3a7b442fd None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.565819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42169049-37f9-42ad-a8ac-4fd3a7b442fd None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.566107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42169049-37f9-42ad-a8ac-4fd3a7b442fd None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.568830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 476/919] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:32.573377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1bbe-960f-4445-8ef7-1cc595f40f2d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.573666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1bbe-960f-4445-8ef7-1cc595f40f2d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.573946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1bbe-960f-4445-8ef7-1cc595f40f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:32.581954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:32.582957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:32.583913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 444/920] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:32.588966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.595992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-97ed1bbe-960f-4445-8ef7-1cc595f40f2d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:32.597490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-97ed1bbe-960f-4445-8ef7-1cc595f40f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:32.665947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 477/921] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:32.688569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed1bbe-960f-4445-8ef7-1cc595f40f2d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.691347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbb718-46fc-4643-b940-2149b8261ed1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.737466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:32.738484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.738865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.739627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.740918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:32.741337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:32.743254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:32.767550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 445/922] 10.222.0.52 () {56 vars in 1149 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:32.774252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.794859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed1bbe-960f-4445-8ef7-1cc595f40f2d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.829336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:32.830150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.830431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.830706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.831431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:32.832883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:32.845097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:32.846801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:32.847888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 478/923] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:32.854135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:32.897966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928468d9-34cf-4a83-bf6a-c52cceb28d0f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.931434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8eec0-b06b-4a4d-8ca8-1a5b964a7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:32.932608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8eec0-b06b-4a4d-8ca8-1a5b964a7203 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.933137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8eec0-b06b-4a4d-8ca8-1a5b964a7203 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.933686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8eec0-b06b-4a4d-8ca8-1a5b964a7203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.944957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8eec0-b06b-4a4d-8ca8-1a5b964a7203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:32.946601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8eec0-b06b-4a4d-8ca8-1a5b964a7203 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:32.962694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c83308-8c07-4ce2-8b53-9ad8a4df31ed None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-bee8eec0-b06b-4a4d-8ca8-1a5b964a7203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:32.965679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:32.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:32.967833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:32.967833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:32.967833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:32.967833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:32.969710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 446/924] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:32.971194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e1334-468c-458c-966d-6ebb397b4e2c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:32.971618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e1334-468c-458c-966d-6ebb397b4e2c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:32.972036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e1334-468c-458c-966d-6ebb397b4e2c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:32.973986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 447/925] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:32.974873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e1334-468c-458c-966d-6ebb397b4e2c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.003554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0071e0b-a15e-4356-b67f-3e6bb473dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.004231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0071e0b-a15e-4356-b67f-3e6bb473dbea None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.004513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0071e0b-a15e-4356-b67f-3e6bb473dbea None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.004826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0071e0b-a15e-4356-b67f-3e6bb473dbea None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.005542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0071e0b-a15e-4356-b67f-3e6bb473dbea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:33.005851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0071e0b-a15e-4356-b67f-3e6bb473dbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.007205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0071e0b-a15e-4356-b67f-3e6bb473dbea None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.016810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 479/926] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:33.016810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755192d-54fe-4c0a-9ce1-ab7c2e6a05ec None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.016810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755192d-54fe-4c0a-9ce1-ab7c2e6a05ec None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.016810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755192d-54fe-4c0a-9ce1-ab7c2e6a05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.032085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-9755192d-54fe-4c0a-9ce1-ab7c2e6a05ec None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:33.033276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9755192d-54fe-4c0a-9ce1-ab7c2e6a05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:33.083610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e1334-468c-458c-966d-6ebb397b4e2c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.096054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 480/927] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:33.096918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755192d-54fe-4c0a-9ce1-ab7c2e6a05ec None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.131043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.131729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.132006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.132282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.133054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:33.133363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.135157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.152418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 448/928] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:33.152418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.209849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755192d-54fe-4c0a-9ce1-ab7c2e6a05ec None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.242227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.242908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.243188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.243491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.244203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:33.244510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.246028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.249233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69691ab3-4348-4a17-aee8-82c4122400ed None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.250777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 481/929] 10.222.0.52 () {56 vars in 1114 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:33.251538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.289102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.289940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.290194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.290459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.291110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.292470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:33.304125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:33.305372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:33.306257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 449/930] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:33.307049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.351755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b83d-fad3-4369-969f-ed3ca2eb3898 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.383502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.384302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.384978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.385249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.391993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.393453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.405208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7334-e2d9-4b79-a530-c138afed6963 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:33.407005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:33.408060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:33.409710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 482/931] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:33.411478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.442739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f670c0b-b913-4314-aee7-0af89bf78f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.443411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670c0b-b913-4314-aee7-0af89bf78f7d None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.443693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670c0b-b913-4314-aee7-0af89bf78f7d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.443971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670c0b-b913-4314-aee7-0af89bf78f7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.444746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f670c0b-b913-4314-aee7-0af89bf78f7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.446115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f670c0b-b913-4314-aee7-0af89bf78f7d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.465941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 450/932] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:33.467176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f587555-3195-4365-b606-3f51cfd91995 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.467460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f587555-3195-4365-b606-3f51cfd91995 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.467729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f587555-3195-4365-b606-3f51cfd91995 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.469254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 451/933] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:33.469974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f587555-3195-4365-b606-3f51cfd91995 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.526261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92290000-ff8b-45eb-bace-c9022b592a3f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.567218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6f80-1cee-4058-9dea-0d276ddb7147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.567893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6f80-1cee-4058-9dea-0d276ddb7147 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.568181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6f80-1cee-4058-9dea-0d276ddb7147 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.568452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6f80-1cee-4058-9dea-0d276ddb7147 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.569242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d6f80-1cee-4058-9dea-0d276ddb7147 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:33.569543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d6f80-1cee-4058-9dea-0d276ddb7147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.570942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d6f80-1cee-4058-9dea-0d276ddb7147 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.576242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 483/934] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:33.577565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a079e-5279-4622-bfc7-d1c01be04562 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.577849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a079e-5279-4622-bfc7-d1c01be04562 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.578122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a079e-5279-4622-bfc7-d1c01be04562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.588776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f587555-3195-4365-b606-3f51cfd91995 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.595101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-339a079e-5279-4622-bfc7-d1c01be04562 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:33.596318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-339a079e-5279-4622-bfc7-d1c01be04562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:33.627095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.627783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.628064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.628348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.629191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:33.629511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.630985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.644408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 452/935] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:33.645336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.668454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 484/936] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:33.669677 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a079e-5279-4622-bfc7-d1c01be04562 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.757959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdefa0-4d1f-4d28-a263-a8594d9a44f9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.771181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a079e-5279-4622-bfc7-d1c01be04562 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.792887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.793649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.793950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.794285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.795001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:33.795349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.796760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.801826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 453/937] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:33.802439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.810315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.811224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.811681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.811984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/d1455f40069444ffba21c84a8eab7e6f/roles/3dbd4cd0a19d4aaea323abe322569413` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.814304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=d1455f40069444ffba21c84a8eab7e6f, role_id=3dbd4cd0a19d4aaea323abe322569413)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.815745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.830785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 485/938] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:45:33 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/d1455f40069444ffba21c84a8eab7e6f/roles/3dbd4cd0a19d4aaea323abe322569413 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:45:33.831602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.907372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cfad-8043-422a-a7fa-0cf50f8afc51 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.943641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.943906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6feb2b-6200-4bc8-80bf-277162462466 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:33.945048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.945536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.946045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.946917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.948539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:33.961668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:33.962699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 18:45:33.963539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:33.966483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 454/939] 10.222.0.52 () {56 vars in 1132 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:33.972728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:33.988144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:33.988144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:33.988817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:33.988817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:33.989623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] RBAC: Adding query filter params (interface=public, service_id=e8f80a64aa754efb805beb8f10636b2e, region_id=RegionOne) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:33.990385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:33.992986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:33.998353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 486/940] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/endpoints?service_id=e8f80a64aa754efb805beb8f10636b2e&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:34.003463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:34.086379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8a14-8c8a-4da7-b4e8-9f887e130223 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:34.117744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c03d-bf29-45b2-a9e0-e47189aebe6a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:34.120712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:34.121674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:34.122154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:34.122623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:34.123526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:34.124047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:34.125635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:34.131015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 455/941] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:34.136975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:34.155834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:34.156937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:34.157436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:34.157920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:34.158821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:34.160496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:34.167123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 487/942] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:34 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:45:34.246500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9721a4c-e183-4b35-aaec-ea2c29c75198 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:34.289562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b4d9-ac0b-42cb-b0d5-f6a67c330f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:34.290715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b4d9-ac0b-42cb-b0d5-f6a67c330f8a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:34.291227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b4d9-ac0b-42cb-b0d5-f6a67c330f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:34.291726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b4d9-ac0b-42cb-b0d5-f6a67c330f8a None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:34.295165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20b4d9-ac0b-42cb-b0d5-f6a67c330f8a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:34.295770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20b4d9-ac0b-42cb-b0d5-f6a67c330f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:34.297429 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20b4d9-ac0b-42cb-b0d5-f6a67c330f8a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:34.303733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 456/943] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:34.309673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:34.419087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b16e02-1f16-4595-9a24-b4e514e35003 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:34.465486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ffca9-5dba-4279-b394-a9225444143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:34.466392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffca9-5dba-4279-b394-a9225444143c None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:34.466832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffca9-5dba-4279-b394-a9225444143c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:34.467253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffca9-5dba-4279-b394-a9225444143c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:34.468155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ffca9-5dba-4279-b394-a9225444143c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:34.469782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ffca9-5dba-4279-b394-a9225444143c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:34.493600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 488/944] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:35.804171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f693d1-1d47-4893-8a8d-219a81acf890 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:35.804699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f693d1-1d47-4893-8a8d-219a81acf890 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:35.804699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f693d1-1d47-4893-8a8d-219a81acf890 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:35.806299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 457/945] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:35.811886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89941-ab54-4b90-81e4-edcf3c539bf2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:35.812279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89941-ab54-4b90-81e4-edcf3c539bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:35.812446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89941-ab54-4b90-81e4-edcf3c539bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:35.829822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-60b89941-ab54-4b90-81e4-edcf3c539bf2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:35.831017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-60b89941-ab54-4b90-81e4-edcf3c539bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:35.904118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 489/946] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:35.927407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f693d1-1d47-4893-8a8d-219a81acf890 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.033098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f693d1-1d47-4893-8a8d-219a81acf890 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.066440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.067035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.067306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.067596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.068321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:36.069809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:36.071201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING keystone.server.flask.common [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 18:45:36.090219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.sql.core [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 18:45:36.090219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 18:45:36.090219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [parameters: {'id': '01cca391e0d94ba0ac54c3fc749fef28', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 18:45:36.090219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79970) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-5c405d04-730e-4455-9aed-c9e356a92b29 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 01cca391e0d94ba0ac54c3fc749fef28.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 01cca391e0d94ba0ac54c3fc749fef28. May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result = self._query(query) May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application conn.query(q) May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 18:45:36.107276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result.read() May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 18:45:36.108169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application next(self.gen) May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application yield resource May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application next(self.gen) May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.session.rollback() May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.force_reraise() May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise self.value May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application session.commit() May 10 18:45:36.109190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._prepare_impl() May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.session.flush() May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._flush(objects) May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application compat.raise_( May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application flush_context.execute() May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 18:45:36.110083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rec.execute(self) May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 18:45:36.110991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result = self._query(query) May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application conn.query(q) May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result.read() May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 18:45:36.111840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [parameters: {'id': '01cca391e0d94ba0ac54c3fc749fef28', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.113787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:36.115813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 01cca391e0d94ba0ac54c3fc749fef28. May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.117992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 458/947] 10.222.0.52 () {60 vars in 1140 bytes} [Tue May 10 18:45:35 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:36.125369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89941-ab54-4b90-81e4-edcf3c539bf2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.163775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b90c2-2c3e-4c76-8a15-b3220f9bed2c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.164057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b90c2-2c3e-4c76-8a15-b3220f9bed2c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.164684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b90c2-2c3e-4c76-8a15-b3220f9bed2c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.170744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 459/948] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:36.179522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbe3a1-7ee3-41ca-8598-85414cc5695c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.180132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbe3a1-7ee3-41ca-8598-85414cc5695c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.180510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbe3a1-7ee3-41ca-8598-85414cc5695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.204555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-54cbe3a1-7ee3-41ca-8598-85414cc5695c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:36.207082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-54cbe3a1-7ee3-41ca-8598-85414cc5695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:36.224819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89941-ab54-4b90-81e4-edcf3c539bf2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.267329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.268767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.269156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.269807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.279293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:36.281051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:36.288835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 460/949] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:36.296391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:36.298037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:36.300017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 490/950] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:36.305435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbe3a1-7ee3-41ca-8598-85414cc5695c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.307112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.421371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d93e-4fa4-427d-920d-51762c474adb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.425745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbe3a1-7ee3-41ca-8598-85414cc5695c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.467079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6ed27-0356-4599-967e-7915f29ff31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.468002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6ed27-0356-4599-967e-7915f29ff31a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.468289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6ed27-0356-4599-967e-7915f29ff31a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.468566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6ed27-0356-4599-967e-7915f29ff31a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.468774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.469669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.470160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.470759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.471974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:36.472430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:36.474548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:36.479290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6ed27-0356-4599-967e-7915f29ff31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-78c6ed27-0356-4599-967e-7915f29ff31a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:36.487543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:36.488725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:36.489719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:36.491962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 491/951] 10.222.0.52 () {56 vars in 1120 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:36.495349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca7cd-e0c5-42d7-97e3-5b8fdfe51237 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.495624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca7cd-e0c5-42d7-97e3-5b8fdfe51237 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.495939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca7cd-e0c5-42d7-97e3-5b8fdfe51237 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.496614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 461/952] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:36.498642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 492/953] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:36.505858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.506406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef399e-fbe1-41e7-8730-445d93cb8e21 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.506870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef399e-fbe1-41e7-8730-445d93cb8e21 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.507241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef399e-fbe1-41e7-8730-445d93cb8e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.525942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-89ef399e-fbe1-41e7-8730-445d93cb8e21 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:36.527433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-89ef399e-fbe1-41e7-8730-445d93cb8e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:36.622252 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 493/954] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:36.635506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a19c-5305-4127-9e95-8709df2f1f41 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.645790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef399e-fbe1-41e7-8730-445d93cb8e21 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.689395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.690008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.690287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.690557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.691338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:36.691646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:36.693088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:36.708266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 462/955] 10.222.0.52 () {56 vars in 1115 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:36.709634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.768014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef399e-fbe1-41e7-8730-445d93cb8e21 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.804423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60f048-49b2-4620-93e7-cb7c6f2e5fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.805302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60f048-49b2-4620-93e7-cb7c6f2e5fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.806020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60f048-49b2-4620-93e7-cb7c6f2e5fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.806294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60f048-49b2-4620-93e7-cb7c6f2e5fd2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.807262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60f048-49b2-4620-93e7-cb7c6f2e5fd2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:36.809187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60f048-49b2-4620-93e7-cb7c6f2e5fd2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:36.817063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73373bf6-05a1-4c48-afe5-999e5e407833 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-8d60f048-49b2-4620-93e7-cb7c6f2e5fd2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:36.823671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:36.825172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:36.826018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:36.827182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 494/956] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:36.828628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29634fc-b2e0-4ed5-865e-93c8cee1e5bf None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.828946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29634fc-b2e0-4ed5-865e-93c8cee1e5bf None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.829221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29634fc-b2e0-4ed5-865e-93c8cee1e5bf None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.830547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 495/957] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:36.833032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29634fc-b2e0-4ed5-865e-93c8cee1e5bf None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.856401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03727c13-af1c-4d4c-a55a-d6d65676457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.857237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727c13-af1c-4d4c-a55a-d6d65676457e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.857522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727c13-af1c-4d4c-a55a-d6d65676457e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.857800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727c13-af1c-4d4c-a55a-d6d65676457e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.868440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03727c13-af1c-4d4c-a55a-d6d65676457e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:36.869996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03727c13-af1c-4d4c-a55a-d6d65676457e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-03727c13-af1c-4d4c-a55a-d6d65676457e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:36.887087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:36.888002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:36.889325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:36.889325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:36.889325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:36.889325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:36.889325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 463/958] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:36.889920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5fbe0-8096-48e1-b545-2f2301a936cf None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.890208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5fbe0-8096-48e1-b545-2f2301a936cf None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.890488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5fbe0-8096-48e1-b545-2f2301a936cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.907320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-49d5fbe0-8096-48e1-b545-2f2301a936cf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:36.908511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-49d5fbe0-8096-48e1-b545-2f2301a936cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:36.938916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29634fc-b2e0-4ed5-865e-93c8cee1e5bf None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:36.973178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:36.973779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:36.974058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:36.974330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:36.982308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 464/959] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:36.982459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:36.982459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:36.982617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5fbe0-8096-48e1-b545-2f2301a936cf None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:36.982691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:36.982691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 496/960] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:36.987471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.079598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5fbe0-8096-48e1-b545-2f2301a936cf None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.088883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6c5a7-3f48-4191-8866-ee78c0216668 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.113691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.114365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.114644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.114925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.115645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:37.115952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.117356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.121664 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.122362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.122642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.122913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.124073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:37.124381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.126193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.137801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 465/961] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:37.137801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.138070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 497/962] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:37.138070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.231674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f988f-4c09-4d16-bcd2-73127eb30351 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.237547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42063d15-5d5a-42ef-b987-1b8cdd6fd245 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.265194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.266006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.266282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.266543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.267201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.268552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.274226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.275292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.275770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.276241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:37.280042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:37.281038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:37.281889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 466/963] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:37.282687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.287871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.289581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:37.304280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:37.305425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 18:45:37.306530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:37.310225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 498/964] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:45:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:37.310922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.389272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87494-6468-4786-abee-223ceed86e38 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.407797 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439b93-4e02-49e6-844f-94c25a07484c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.422604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.423278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.423557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.423831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.424578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.425977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.447657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 467/965] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:45:37.448505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.468503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.469407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.469951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.470303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.471739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:37.472152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.474162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.484968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 499/966] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:37.487390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.567831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620b89-2add-4f12-ae97-0afd58c856df None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.606554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.607254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.607537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.607807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.608665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:37.609015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.610468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.612526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64554ebd-e23a-4e57-9738-08c926f00684 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.630475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 468/967] 10.222.0.52 () {56 vars in 1149 bytes} [Tue May 10 18:45:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:37.636181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:37.655078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.656156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.656635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.657149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.658072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:37.658577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.660149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.666911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 500/968] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:37.746278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c07f6-e812-423b-88ae-4b0ca8b784ce None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:37.785995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:37.787714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:37.787994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:37.788269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:37.862549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:37.864037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:37.963690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 469/969] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 18:45:37.969084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:38.077261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a46bf2-2139-47f6-b2a9-fd3c9490fc32 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:38.114183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:38.114991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:38.115272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:38.115546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:38.126168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:38.127595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:38.144477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:38.145436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:38.147301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:38.147301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:38.147301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:38.147301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:38.147301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 501/970] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:38.151367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:38.250196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838dcf3-8fdf-481f-b885-50bed7193db9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:38.285481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:38.286158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:38.286437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:38.286713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:38.287447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:38.287753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:38.289154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:38.301428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 470/971] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:38.307032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:38.412009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35777-2e21-44f5-b098-d7ed26a56553 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:38.445318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:38.446163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:38.446443 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:38.446762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:38.453766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:38.455210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:38.469377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:38.471909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:38.474120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 502/972] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:38.482265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:38.580490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf6f2-d6ac-48ff-a35d-2fff8fba2986 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:38.613854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60e4e5-e0a9-4c7f-8dab-1a8ba8de54f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:38.614811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60e4e5-e0a9-4c7f-8dab-1a8ba8de54f6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:38.615269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60e4e5-e0a9-4c7f-8dab-1a8ba8de54f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:38.615863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60e4e5-e0a9-4c7f-8dab-1a8ba8de54f6 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:38.616857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60e4e5-e0a9-4c7f-8dab-1a8ba8de54f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:38.617380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60e4e5-e0a9-4c7f-8dab-1a8ba8de54f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:38.619038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60e4e5-e0a9-4c7f-8dab-1a8ba8de54f6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:38.631424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 471/973] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:38.638015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:38.740574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8581-9703-4a70-b9e7-fa78577db149 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:38.776327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7e402-e0a8-4e31-b89f-def3d9468b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:38.777685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7e402-e0a8-4e31-b89f-def3d9468b21 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:38.778332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7e402-e0a8-4e31-b89f-def3d9468b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:38.779114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7e402-e0a8-4e31-b89f-def3d9468b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:38.780608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7e402-e0a8-4e31-b89f-def3d9468b21 None admin] RBAC: Adding query filter params (role.id=3dbd4cd0a19d4aaea323abe322569413, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=d1455f40069444ffba21c84a8eab7e6f) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:38.781376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7e402-e0a8-4e31-b89f-def3d9468b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:38.784082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7e402-e0a8-4e31-b89f-def3d9468b21 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:38.791473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 503/974] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:38 2022] GET /identity/v3/role_assignments?user.id=d1455f40069444ffba21c84a8eab7e6f&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=3dbd4cd0a19d4aaea323abe322569413 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:38.891182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3c23-6de7-4c30-bc68-0c155f462d6d None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:38.891704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3c23-6de7-4c30-bc68-0c155f462d6d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:38.891704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3c23-6de7-4c30-bc68-0c155f462d6d None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:38.893646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 472/975] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:38.899651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79f6d-2de9-4f25-8fae-aa2bdc0dbd90 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:38.899978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79f6d-2de9-4f25-8fae-aa2bdc0dbd90 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:38.900196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b79f6d-2de9-4f25-8fae-aa2bdc0dbd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:38.918156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-70b79f6d-2de9-4f25-8fae-aa2bdc0dbd90 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:38.919355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-70b79f6d-2de9-4f25-8fae-aa2bdc0dbd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:38.990957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 504/976] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:39.015592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3c23-6de7-4c30-bc68-0c155f462d6d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:39.116347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3c23-6de7-4c30-bc68-0c155f462d6d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:39.149302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:39.150274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:39.150724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:39.151242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:39.152216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:39.153853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:39.169141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.sql.core [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 18:45:39.169141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 18:45:39.169141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [parameters: {'user_id': 'd85f835892c84340883b79588be1c234', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 18:45:39.169141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79970) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result = self._query(query) May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application conn.query(q) May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result.read() May 10 18:45:39.177439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 18:45:39.178277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application next(self.gen) May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application yield resource May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application next(self.gen) May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.session.rollback() May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.force_reraise() May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise self.value May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application session.commit() May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 18:45:39.179347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._prepare_impl() May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.session.flush() May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._flush(objects) May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application compat.raise_( May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application flush_context.execute() May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rec.execute(self) May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 18:45:39.180270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 18:45:39.181440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result = self._query(query) May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application conn.query(q) May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application result.read() May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 18:45:39.182405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd85f835892c84340883b79588be1c234', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:39.183354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 18:45:39.184184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 18:45:39.185192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 18:45:39.185192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 18:45:39.185192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 18:45:39.185192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 18:45:39.185192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 18:45:39.185192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:39.187549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 473/977] 10.222.0.52 () {60 vars in 1131 bytes} [Tue May 10 18:45:39 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:39.193607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b79f6d-2de9-4f25-8fae-aa2bdc0dbd90 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:39.292360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b79f6d-2de9-4f25-8fae-aa2bdc0dbd90 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:39.331163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c612-ed6d-4cfb-ba40-9f3f436aa584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:39.331986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c612-ed6d-4cfb-ba40-9f3f436aa584 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:39.332260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c612-ed6d-4cfb-ba40-9f3f436aa584 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:39.332536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c612-ed6d-4cfb-ba40-9f3f436aa584 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:39.339995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c612-ed6d-4cfb-ba40-9f3f436aa584 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:39.341474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c612-ed6d-4cfb-ba40-9f3f436aa584 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-c376c612-ed6d-4cfb-ba40-9f3f436aa584 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:39.356944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:39.357967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:39.358903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 505/978] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:39.365830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:39.468155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b267-33b3-4e40-94db-6fa2ec4e97ea None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:39.501883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cddd-2561-4fe0-965b-fb07aa2e56bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:39.503020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cddd-2561-4fe0-965b-fb07aa2e56bf None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:39.503496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cddd-2561-4fe0-965b-fb07aa2e56bf None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:39.503960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cddd-2561-4fe0-965b-fb07aa2e56bf None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:39.505026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53cddd-2561-4fe0-965b-fb07aa2e56bf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:39.505546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53cddd-2561-4fe0-965b-fb07aa2e56bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:39.507397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53cddd-2561-4fe0-965b-fb07aa2e56bf None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:39.546297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 474/979] 10.222.0.52 () {56 vars in 1101 bytes} [Tue May 10 18:45:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:39.857230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a9df-1c7c-4a06-8be3-70e62d7a3ba4 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:39.857588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a9df-1c7c-4a06-8be3-70e62d7a3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:39.857787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a9df-1c7c-4a06-8be3-70e62d7a3ba4 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:39.859323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 506/980] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:39.864464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e66f-2c7e-4d04-9aef-844f7a20c43f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:39.864793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e66f-2c7e-4d04-9aef-844f7a20c43f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:39.865076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e66f-2c7e-4d04-9aef-844f7a20c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:39.881839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ac13e66f-2c7e-4d04-9aef-844f7a20c43f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:39.883342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ac13e66f-2c7e-4d04-9aef-844f7a20c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:39.931370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655e5b-22c9-4604-bc8f-05e7a3b5abbb None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:39.931700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655e5b-22c9-4604-bc8f-05e7a3b5abbb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:39.931886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655e5b-22c9-4604-bc8f-05e7a3b5abbb None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:39.933628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 507/981] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:39.940588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb7bf-ea59-4c50-91b2-fe5c638a704d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:39.940996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb7bf-ea59-4c50-91b2-fe5c638a704d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:39.941338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb7bf-ea59-4c50-91b2-fe5c638a704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:39.950741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 475/982] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:39.957873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-556eb7bf-ea59-4c50-91b2-fe5c638a704d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:39.959042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-556eb7bf-ea59-4c50-91b2-fe5c638a704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:39.972709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e66f-2c7e-4d04-9aef-844f7a20c43f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:40.025420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 508/983] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:40.047755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb7bf-ea59-4c50-91b2-fe5c638a704d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:40.074365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e66f-2c7e-4d04-9aef-844f7a20c43f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:40.107177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:40.108065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:40.108278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:40.108552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:40.109264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:40.110642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:40.122540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:40.123771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:40.124789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 476/984] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:40.129704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:40.150241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb7bf-ea59-4c50-91b2-fe5c638a704d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:40.183701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:40.184429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:40.184772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:40.185039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:40.185786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:40.187183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:40.201326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 509/985] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:40 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:40.231601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d780fb-7832-4837-95ed-e29c7725a830 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:40.275384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:40.276058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:40.276338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:40.276605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:40.277400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:40.277701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:40.279072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:40.289498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 477/986] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:40.291696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:40.396130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76894993-a3b4-4450-9641-35529ecabeb9 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:40.434744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:40.435429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:40.435711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:40.435984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:40.436788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:40.437103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:40.438479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:40.443838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 510/987] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:40.449638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:40.549724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a9eb-4d57-49b6-b4be-09da53f1ec3e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:40.583532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3ef90-f65f-45a3-b190-8c14142dbaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:40.584204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3ef90-f65f-45a3-b190-8c14142dbaff None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:40.584481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3ef90-f65f-45a3-b190-8c14142dbaff None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:40.584783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3ef90-f65f-45a3-b190-8c14142dbaff None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:40.585594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3ef90-f65f-45a3-b190-8c14142dbaff None admin] RBAC: Adding query filter params (interface=admin, service_id=e8f80a64aa754efb805beb8f10636b2e, region_id=RegionOne) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:40.585903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3ef90-f65f-45a3-b190-8c14142dbaff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:40.587270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3ef90-f65f-45a3-b190-8c14142dbaff None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:40.592601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 478/988] 10.222.0.52 () {56 vars in 1249 bytes} [Tue May 10 18:45:40 2022] GET /identity/v3/endpoints?service_id=e8f80a64aa754efb805beb8f10636b2e&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:40.598151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:40.698093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7eaf-3aff-41f0-a1ec-6f43c5ca558c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:40.732046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff53eb9-b707-4909-a0bc-6f6719cab723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:40.732713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff53eb9-b707-4909-a0bc-6f6719cab723 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:40.734669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff53eb9-b707-4909-a0bc-6f6719cab723 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:40.734669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff53eb9-b707-4909-a0bc-6f6719cab723 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:40.734669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff53eb9-b707-4909-a0bc-6f6719cab723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:40.735417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff53eb9-b707-4909-a0bc-6f6719cab723 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:40.742182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 511/989] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:40 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:45:41.181633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ff694-0ce3-4b27-88ab-7814fc58c46a None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:41.182212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ff694-0ce3-4b27-88ab-7814fc58c46a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:41.182212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ff694-0ce3-4b27-88ab-7814fc58c46a None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:41.183804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 479/990] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:41.188995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36376dd-0e0a-45f4-ae46-13e73493f25f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:41.189426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36376dd-0e0a-45f4-ae46-13e73493f25f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:41.189579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36376dd-0e0a-45f4-ae46-13e73493f25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:41.207649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c36376dd-0e0a-45f4-ae46-13e73493f25f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:41.208887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c36376dd-0e0a-45f4-ae46-13e73493f25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:41.284808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 512/991] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:41.301466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ff694-0ce3-4b27-88ab-7814fc58c46a None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:41.405563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ff694-0ce3-4b27-88ab-7814fc58c46a None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:41.439416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:41.440150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:41.440434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:41.440729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] PATH_INFO: `/v3/services/image` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:41.441391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:41.442753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:41.455025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:41.456011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:41.456904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 480/992] 10.222.0.52 () {56 vars in 1105 bytes} [Tue May 10 18:45:41 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:41.462369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36376dd-0e0a-45f4-ae46-13e73493f25f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:41.558005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36376dd-0e0a-45f4-ae46-13e73493f25f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:41.591632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef7b7-252d-4b32-8694-65f6938ea978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:41.592288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef7b7-252d-4b32-8694-65f6938ea978 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:41.592570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef7b7-252d-4b32-8694-65f6938ea978 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:41.592861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef7b7-252d-4b32-8694-65f6938ea978 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:41.593566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef7b7-252d-4b32-8694-65f6938ea978 None admin] RBAC: Adding query filter params (name=image) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:41.593866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef7b7-252d-4b32-8694-65f6938ea978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:41.595224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef7b7-252d-4b32-8694-65f6938ea978 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:41.604457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 513/993] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:41.605623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:41.702299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c654c-af98-4d65-93df-509aa7a71b1c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:41.734711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528353-1184-4240-aff3-c1251d651071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:41.735365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528353-1184-4240-aff3-c1251d651071 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:41.735644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528353-1184-4240-aff3-c1251d651071 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:41.735913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528353-1184-4240-aff3-c1251d651071 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:41.736610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528353-1184-4240-aff3-c1251d651071 None admin] RBAC: Adding query filter params (type=image) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:41.736934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528353-1184-4240-aff3-c1251d651071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:41.738300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528353-1184-4240-aff3-c1251d651071 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:41.742799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 481/994] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:42.458597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f303-38fc-4e4b-83c3-2d1e9c5e5165 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:42.459158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f303-38fc-4e4b-83c3-2d1e9c5e5165 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:42.459158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f303-38fc-4e4b-83c3-2d1e9c5e5165 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:42.460547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 514/995] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:42.466116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d4864-8148-4969-90f7-3afe85002e62 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:42.466554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d4864-8148-4969-90f7-3afe85002e62 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:42.466630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d4864-8148-4969-90f7-3afe85002e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:42.483902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f06d4864-8148-4969-90f7-3afe85002e62 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:42.485121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f06d4864-8148-4969-90f7-3afe85002e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:42.556896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 482/996] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:42.575892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1f303-38fc-4e4b-83c3-2d1e9c5e5165 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:42.678223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1f303-38fc-4e4b-83c3-2d1e9c5e5165 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:42.712504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:42.713551 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:42.713836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:42.714111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:42.714992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:42.716369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:42.728085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:42.729150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:42.735373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 515/997] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:42.736180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d4864-8148-4969-90f7-3afe85002e62 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:42.841839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d4864-8148-4969-90f7-3afe85002e62 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:42.877141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943ed5b-42f9-4a34-892b-bd544be75ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:42.877818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943ed5b-42f9-4a34-892b-bd544be75ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:42.878101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943ed5b-42f9-4a34-892b-bd544be75ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:42.878375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943ed5b-42f9-4a34-892b-bd544be75ef1 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:42.879096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943ed5b-42f9-4a34-892b-bd544be75ef1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:42.879404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943ed5b-42f9-4a34-892b-bd544be75ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:42.880796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943ed5b-42f9-4a34-892b-bd544be75ef1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:42.886171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 483/998] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:42.891922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:42.978880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748d27-75ca-434a-9d0b-59373810a3d3 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:42.978880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748d27-75ca-434a-9d0b-59373810a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:42.978880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748d27-75ca-434a-9d0b-59373810a3d3 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:42.978880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 484/999] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:42.984132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2316-84f5-4aab-a4cc-9912b82ed62e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:42.984423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2316-84f5-4aab-a4cc-9912b82ed62e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:42.984725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2316-84f5-4aab-a4cc-9912b82ed62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:42.994892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c16d9-d992-4944-9981-ada8064b80b7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:43.001228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f73d2316-84f5-4aab-a4cc-9912b82ed62e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:43.002420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f73d2316-84f5-4aab-a4cc-9912b82ed62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:43.028315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:43.028995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.029280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.029561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.030281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:43.030601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:43.031970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:43.036789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 516/1000] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:43.042653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:43.079781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 485/1001] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:43.102367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2316-84f5-4aab-a4cc-9912b82ed62e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:43.136229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9df5-b61e-4fac-88d0-6b921482f7d3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:43.168695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:43.169618 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.169904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.170181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.171003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] RBAC: Adding query filter params (interface=public, service_id=aad02085fd9840d8b936cc227cff68bd, region_id=RegionOne) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:43.171289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:43.172657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:43.177753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 517/1002] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:45:43 2022] GET /identity/v3/endpoints?service_id=aad02085fd9840d8b936cc227cff68bd&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:43.183024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:43.199798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2316-84f5-4aab-a4cc-9912b82ed62e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:43.232625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:43.233400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.233679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.233955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.234617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:43.236003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:43.247891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:43.248927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:43.249790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 486/1003] 10.222.0.52 () {56 vars in 1126 bytes} [Tue May 10 18:45:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:43.255025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:43.281865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28cc6-f300-4841-9467-63e281a2fc84 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:43.316148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:43.316859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.317147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.317428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.318146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:43.319494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:43.325977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 518/1004] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:43 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:45:43.354540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee9de0-4583-453e-a056-8194ef90fc95 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:43.390950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:43.391643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.391926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.392204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.392997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:43.393303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:43.394758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:43.404751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 487/1005] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:43.406861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:43.513848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1de627-fd74-4774-bffe-c5a740a4abdb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:43.548480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7573c-6a92-4a87-9fdb-bbc914ae7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:43.549228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7573c-6a92-4a87-9fdb-bbc914ae7334 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.549501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7573c-6a92-4a87-9fdb-bbc914ae7334 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.549787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7573c-6a92-4a87-9fdb-bbc914ae7334 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.550504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7573c-6a92-4a87-9fdb-bbc914ae7334 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:43.550816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7573c-6a92-4a87-9fdb-bbc914ae7334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:43.552198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7573c-6a92-4a87-9fdb-bbc914ae7334 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:43.557254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 519/1006] 10.222.0.52 () {56 vars in 1122 bytes} [Tue May 10 18:45:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:43.563177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:43.659172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59457192-a920-4d67-bb03-2bf9fab4ced1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:43.693875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5439eb-0339-4abe-b7be-ba17b2d6e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:43.694540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5439eb-0339-4abe-b7be-ba17b2d6e73e None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.694822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5439eb-0339-4abe-b7be-ba17b2d6e73e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.695102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5439eb-0339-4abe-b7be-ba17b2d6e73e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.695859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5439eb-0339-4abe-b7be-ba17b2d6e73e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:43.697274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5439eb-0339-4abe-b7be-ba17b2d6e73e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:43.715820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 488/1007] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:43.941994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68f54-bde3-437f-a994-a3c4324bd73a None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.942250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68f54-bde3-437f-a994-a3c4324bd73a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.942528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68f54-bde3-437f-a994-a3c4324bd73a None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.943897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 520/1008] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:43.949297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c2c3-b8e9-4c9c-8e9e-27ca2152920b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:43.949568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c2c3-b8e9-4c9c-8e9e-27ca2152920b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:43.949854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c2c3-b8e9-4c9c-8e9e-27ca2152920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:43.966766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b0a0c2c3-b8e9-4c9c-8e9e-27ca2152920b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:43.967934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b0a0c2c3-b8e9-4c9c-8e9e-27ca2152920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:44.044315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 489/1009] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:44.066048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68f54-bde3-437f-a994-a3c4324bd73a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:44.166803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68f54-bde3-437f-a994-a3c4324bd73a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:44.200714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6e40-b185-4cc6-82cd-609c129654f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:44.201342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6e40-b185-4cc6-82cd-609c129654f3 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:44.201631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6e40-b185-4cc6-82cd-609c129654f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:44.201905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6e40-b185-4cc6-82cd-609c129654f3 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:44.202663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e6e40-b185-4cc6-82cd-609c129654f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:44.204042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e6e40-b185-4cc6-82cd-609c129654f3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:44.224715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 521/1010] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:44 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:45.582583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57e194-9ef3-4bbf-80df-393cadcdbb32 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:45.583126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57e194-9ef3-4bbf-80df-393cadcdbb32 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:45.583126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57e194-9ef3-4bbf-80df-393cadcdbb32 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:45.584706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 490/1011] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:45.589831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fbc22-373d-4140-8a63-c316baf7cc9a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:45.590262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fbc22-373d-4140-8a63-c316baf7cc9a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:45.590342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fbc22-373d-4140-8a63-c316baf7cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:45.607654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-9f7fbc22-373d-4140-8a63-c316baf7cc9a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:45.608901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9f7fbc22-373d-4140-8a63-c316baf7cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:45.680727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 522/1012] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:45 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:45.703072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57e194-9ef3-4bbf-80df-393cadcdbb32 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:45.808220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57e194-9ef3-4bbf-80df-393cadcdbb32 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:45.842715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f58536-ec54-4967-a831-a098c10c92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:45.843516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58536-ec54-4967-a831-a098c10c92de None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:45.843798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58536-ec54-4967-a831-a098c10c92de None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:45.844069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58536-ec54-4967-a831-a098c10c92de None admin] PATH_INFO: `/v3/services/compute` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:45.845172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f58536-ec54-4967-a831-a098c10c92de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:45.846725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f58536-ec54-4967-a831-a098c10c92de None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c4f58536-ec54-4967-a831-a098c10c92de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:45.859260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:45.860264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:45.865481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 491/1013] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:45.868664 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fbc22-373d-4140-8a63-c316baf7cc9a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:45.968407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fbc22-373d-4140-8a63-c316baf7cc9a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:45.970420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37398d-adb5-4cec-9bf1-16e523283491 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:45.970715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37398d-adb5-4cec-9bf1-16e523283491 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:45.970990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37398d-adb5-4cec-9bf1-16e523283491 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:45.972399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 492/1014] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:45.977544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccbb2-f4c1-422f-8747-d878139d0d85 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:45.977932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccbb2-f4c1-422f-8747-d878139d0d85 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:45.978280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccbb2-f4c1-422f-8747-d878139d0d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:45.994854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-99eccbb2-f4c1-422f-8747-d878139d0d85 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:45.996093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-99eccbb2-f4c1-422f-8747-d878139d0d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:46.011644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:46.012700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.013366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.013813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.014686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:46.015138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:46.017308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:46.024718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 523/1015] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:46.028977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:46.064724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 493/1016] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:45 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:46.086873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eccbb2-f4c1-422f-8747-d878139d0d85 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:46.138555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02554bd7-11a9-491a-ad04-0849c5adcd72 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:46.172052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:46.172775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.173062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.173338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.174048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] RBAC: Adding query filter params (type=compute) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:46.174369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:46.175764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:46.180397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 524/1017] 10.222.0.52 () {56 vars in 1112 bytes} [Tue May 10 18:45:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:46.181880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eccbb2-f4c1-422f-8747-d878139d0d85 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:46.186110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:46.218141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:46.219008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.219219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.219489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.220712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:46.222196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:46.224101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 494/1018] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:46.230059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:46.286889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00835ac-faa1-4fb3-8b84-074a319465cc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:46.320923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aadf2-a42e-41e6-9a9e-d055ab3d5aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:46.321624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aadf2-a42e-41e6-9a9e-d055ab3d5aab None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.321906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aadf2-a42e-41e6-9a9e-d055ab3d5aab None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.322184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aadf2-a42e-41e6-9a9e-d055ab3d5aab None admin] PATH_INFO: `/v3/endpoints` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.322933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aadf2-a42e-41e6-9a9e-d055ab3d5aab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:46.324370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aadf2-a42e-41e6-9a9e-d055ab3d5aab None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:46.331397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee3a65-76d9-4aeb-9464-9e3f2ad706f9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:46.343301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 525/1019] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:46.376763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ec624-668f-463d-a8ed-c4ee10de2882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:46.377452 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec624-668f-463d-a8ed-c4ee10de2882 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.377736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec624-668f-463d-a8ed-c4ee10de2882 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.378011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec624-668f-463d-a8ed-c4ee10de2882 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.378748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ec624-668f-463d-a8ed-c4ee10de2882 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:46.380242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ec624-668f-463d-a8ed-c4ee10de2882 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:46.408984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 495/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:45:46 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:46.426634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196f00c-b5ef-4840-a8ff-55f6162ff49b None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.426918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196f00c-b5ef-4840-a8ff-55f6162ff49b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.427344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196f00c-b5ef-4840-a8ff-55f6162ff49b None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.429307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 526/1021] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:46.437860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8195-9846-4c48-933f-602e771c6e7c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.438116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8195-9846-4c48-933f-602e771c6e7c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.438434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8195-9846-4c48-933f-602e771c6e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.459595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-48da8195-9846-4c48-933f-602e771c6e7c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:46.460909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-48da8195-9846-4c48-933f-602e771c6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:46.538176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 496/1022] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:46.561033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196f00c-b5ef-4840-a8ff-55f6162ff49b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:46.669376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196f00c-b5ef-4840-a8ff-55f6162ff49b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:46.702369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:46.703172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.703444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.703720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] PATH_INFO: `/v3/services/image` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.704373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:46.705791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:46.718640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:46.719661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:46.720543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:46.721821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 527/1023] 10.222.0.52 () {56 vars in 1105 bytes} [Tue May 10 18:45:46 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:46.727194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8195-9846-4c48-933f-602e771c6e7c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:46.829244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8195-9846-4c48-933f-602e771c6e7c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:46.863066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:46.864041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:46.864519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:46.864982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:46.865861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] RBAC: Adding query filter params (name=image) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:46.866334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:46.867883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:46.877677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 497/1024] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:46.878938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:46.976107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3d2db-8892-4e8e-b311-a1e7fbb3db04 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:47.007854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:47.008522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:47.008838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:47.009468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:47.010174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] RBAC: Adding query filter params (type=image) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:47.010478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:47.011897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:47.016767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 528/1025] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:47.022815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:47.130684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5f7a9-cf05-414f-9dd1-63257e93661e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:47.171129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e187c8-04b5-454d-8278-941770729ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:47.171783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e187c8-04b5-454d-8278-941770729ee8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:47.172063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e187c8-04b5-454d-8278-941770729ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:47.172332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e187c8-04b5-454d-8278-941770729ee8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:47.173155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e187c8-04b5-454d-8278-941770729ee8 None admin] RBAC: Adding query filter params (interface=public, service_id=4f0fcd9e0d4043af956a053e94625d2a, region_id=RegionOne) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:47.173449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e187c8-04b5-454d-8278-941770729ee8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:47.174817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e187c8-04b5-454d-8278-941770729ee8 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:47.180101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 498/1026] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:45:47 2022] GET /identity/v3/endpoints?service_id=4f0fcd9e0d4043af956a053e94625d2a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:47.185727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:47.283240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f8f1-f6f3-41c1-bdb5-96262f25dbc3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:47.317152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229212bc-b124-423f-8cc8-da2a97f3ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:47.317826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229212bc-b124-423f-8cc8-da2a97f3ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:47.318102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229212bc-b124-423f-8cc8-da2a97f3ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:47.318374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229212bc-b124-423f-8cc8-da2a97f3ddb3 None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:47.319053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229212bc-b124-423f-8cc8-da2a97f3ddb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:47.320415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229212bc-b124-423f-8cc8-da2a97f3ddb3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:47.326993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 529/1027] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:45:47 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:45:48.667399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3b81-e613-4f9e-8cb3-a733aa741f19 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:48.667930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3b81-e613-4f9e-8cb3-a733aa741f19 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:48.667930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3b81-e613-4f9e-8cb3-a733aa741f19 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:48.669541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 499/1028] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:48.674865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eff93-8e42-470e-81c7-40ad41915581 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:48.675284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eff93-8e42-470e-81c7-40ad41915581 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:48.675474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eff93-8e42-470e-81c7-40ad41915581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:48.692732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-224eff93-8e42-470e-81c7-40ad41915581 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:48.693577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8c4f-f89f-4a68-9224-d57403dac443 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:48.693861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8c4f-f89f-4a68-9224-d57403dac443 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:48.693977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-224eff93-8e42-470e-81c7-40ad41915581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:48.694138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8c4f-f89f-4a68-9224-d57403dac443 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:48.695508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 500/1029] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:48.700820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81711775-eec2-4f9d-8a93-f4ae011fb8cf None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:48.701077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81711775-eec2-4f9d-8a93-f4ae011fb8cf None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:48.701357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81711775-eec2-4f9d-8a93-f4ae011fb8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:48.718236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-81711775-eec2-4f9d-8a93-f4ae011fb8cf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:48.719353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-81711775-eec2-4f9d-8a93-f4ae011fb8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:48.758455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 530/1030] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:48.783617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 501/1031] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:48.783803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224eff93-8e42-470e-81c7-40ad41915581 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:48.807107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81711775-eec2-4f9d-8a93-f4ae011fb8cf None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:48.881421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224eff93-8e42-470e-81c7-40ad41915581 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:48.903281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81711775-eec2-4f9d-8a93-f4ae011fb8cf None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:48.916119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:48.916955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:48.917240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:48.917517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:48.918680 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:48.920111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:48.921761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 531/1032] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:48.927310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:48.937337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:48.938406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:48.938933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:48.939209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:48.948926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:48.956998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:48.957962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:48.958814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:48.963340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 502/1033] 10.222.0.52 () {56 vars in 1120 bytes} [Tue May 10 18:45:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:48.964088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.024266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fed0d-d7a7-448a-a593-2ca0241da044 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.058041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.058724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.059005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.059281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.059632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7a694-b097-42b3-87c7-cb380c0cc58a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.059996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.061471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.081576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 532/1034] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:45:48 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:49.094813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.095797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.096074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.096347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.097165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:49.097477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.098883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.108714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 503/1035] 10.222.0.52 () {56 vars in 1115 bytes} [Tue May 10 18:45:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:49.115599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.222841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7056d7-add9-49b3-8e23-b38f522d3995 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.261163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.261992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.262282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.262546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.274819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.276708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:49.293612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:49.294799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:49.295836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:49.295836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:49.295836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:49.295836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:49.295836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 533/1036] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:49.300586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.402893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4c1f-ee2a-4bbc-aafb-ab7233b7b42f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.436280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e1dbd-7080-4a21-8ca3-d4fbcd70f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.436984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e1dbd-7080-4a21-8ca3-d4fbcd70f8cb None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.437264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e1dbd-7080-4a21-8ca3-d4fbcd70f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.437532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e1dbd-7080-4a21-8ca3-d4fbcd70f8cb None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.438259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e1dbd-7080-4a21-8ca3-d4fbcd70f8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:49.438561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e1dbd-7080-4a21-8ca3-d4fbcd70f8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.439928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e1dbd-7080-4a21-8ca3-d4fbcd70f8cb None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.452170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 504/1037] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:49.457762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.533093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cb0d2-31fa-486e-84c3-cd8fdf9c4a49 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.533282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cb0d2-31fa-486e-84c3-cd8fdf9c4a49 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.533593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cb0d2-31fa-486e-84c3-cd8fdf9c4a49 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.534984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 505/1038] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:49.540045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e47b1d-2f9f-41e3-8864-9c2772da8298 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.540337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e47b1d-2f9f-41e3-8864-9c2772da8298 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.540601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e47b1d-2f9f-41e3-8864-9c2772da8298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.554361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291910d-2249-4fe1-9cce-b3f94a61dd4a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.558897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-06e47b1d-2f9f-41e3-8864-9c2772da8298 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:49.560079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-06e47b1d-2f9f-41e3-8864-9c2772da8298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:49.589928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.590749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.591008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.591291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.598859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.600302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:49.614104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:49.615190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:49.616151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 534/1039] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:49.621272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.630769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 506/1040] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:49.653236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e47b1d-2f9f-41e3-8864-9c2772da8298 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.719788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38be6-34d4-4bb9-bd1b-bac4cb198b8c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.753328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e47b1d-2f9f-41e3-8864-9c2772da8298 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.755192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.755887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.756170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.756450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.757333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:49.757647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.759436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.776561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 535/1041] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:49.782116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.788269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.789045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.789383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.789662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] PATH_INFO: `/v3/services/image` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.790323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.791687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:49.803536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:49.804588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:49.805516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 507/1042] 10.222.0.52 () {56 vars in 1105 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:49.812807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.881301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cba00-5c20-4187-892d-9c0a1faa0f5c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.912893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a701-4be0-44d8-a1de-58bb30794c95 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:49.918326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.918993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.919273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.919866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.945433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:49.946443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:49.946789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:49.947135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:49.947927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] RBAC: Adding query filter params (name=image) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:49.948396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.949904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:49.955053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 508/1043] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:49.960701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:49.988278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:49.990053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.054463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567c64-5a04-43b3-9648-092e95094f5c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:50.084397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 536/1044] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 18:45:50.090579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:50.092505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:50.093293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:50.093581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:50.093856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:50.094570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] RBAC: Adding query filter params (type=image) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:50.094877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:50.096248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.106206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 509/1045] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:50.107727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:50.201983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d501628-edb8-49ca-b048-54c2fe405d6a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:50.205171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed7b58-3388-4bd7-825c-50177664e693 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:50.235222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:50.236014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:50.236289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:50.236532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:50.241472 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:50.242356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:50.243212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:50.243671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:50.245363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:50.246655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:50.247104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.248125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:50.269872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:50.276721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:50.277805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:50.277805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:50.277805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:50.277805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:50.278074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 510/1046] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:45:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:45:50.278170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 537/1047] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:50.278252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:50.395832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768371c4-0693-4fef-a52a-84468f2000e5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:50.433356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:50.434431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:50.434940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:50.435440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:50.436389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:50.436923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:50.438543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.453570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 511/1048] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:50.458373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:50.559007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af811f-f50a-4a11-a00c-bba659e4cba3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:50.592168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:50.592986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:50.593263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:50.593531 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:50.600067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:50.601525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:50.614942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:50.615807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:50.617215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 538/1049] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:50.622210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:50.719838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d63cb-4cb0-4f90-8795-883af1eb1f61 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:50.753014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870993-658a-4599-b9b4-22fdab1c89c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:50.753678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870993-658a-4599-b9b4-22fdab1c89c8 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:50.754221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870993-658a-4599-b9b4-22fdab1c89c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:50.754221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870993-658a-4599-b9b4-22fdab1c89c8 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:50.754990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870993-658a-4599-b9b4-22fdab1c89c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:50.755293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870993-658a-4599-b9b4-22fdab1c89c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:50.756735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870993-658a-4599-b9b4-22fdab1c89c8 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.768651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 512/1050] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:50.774511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:50.875498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f975-fc84-4328-a299-2c74c0c4ef1c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:50.909498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e09c8-4c9a-48a1-b848-268f29d9fb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:50.910187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e09c8-4c9a-48a1-b848-268f29d9fb9b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:50.910404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e09c8-4c9a-48a1-b848-268f29d9fb9b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:50.910705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e09c8-4c9a-48a1-b848-268f29d9fb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:50.911512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e09c8-4c9a-48a1-b848-268f29d9fb9b None admin] RBAC: Adding query filter params (role.id=3dbd4cd0a19d4aaea323abe322569413, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=dff69f29cd4341f488887fea0dd2e540) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:50.911818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e09c8-4c9a-48a1-b848-268f29d9fb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:50.913291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e09c8-4c9a-48a1-b848-268f29d9fb9b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:50.924759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 539/1051] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:50 2022] GET /identity/v3/role_assignments?user.id=dff69f29cd4341f488887fea0dd2e540&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=3dbd4cd0a19d4aaea323abe322569413 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:51.399057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2975-4bc2-48c7-b80e-0e53660a12a5 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:51.399308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2975-4bc2-48c7-b80e-0e53660a12a5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:51.399580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2975-4bc2-48c7-b80e-0e53660a12a5 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:51.401012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 513/1052] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:51.406681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9376-2176-4170-8635-2e3ffe788ec5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:51.407084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9376-2176-4170-8635-2e3ffe788ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:51.407250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9376-2176-4170-8635-2e3ffe788ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:51.425275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-62cf9376-2176-4170-8635-2e3ffe788ec5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:51.429524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-62cf9376-2176-4170-8635-2e3ffe788ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:51.499566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 540/1053] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:51.526006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef2975-4bc2-48c7-b80e-0e53660a12a5 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:51.624363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef2975-4bc2-48c7-b80e-0e53660a12a5 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:51.657992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:51.658703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:51.658954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:51.659244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:51.669511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:51.676931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:51.677897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:51.678785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:51.681056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 514/1054] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:51.684350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf9376-2176-4170-8635-2e3ffe788ec5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:51.784572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf9376-2176-4170-8635-2e3ffe788ec5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:51.818613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:51.819288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:51.819566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:51.819843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:51.820599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:51.820938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:51.822320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:51.834976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 541/1055] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:51.836548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:51.935926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cedb52-df80-455a-9c59-5868878c2b29 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:51.969686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:51.970573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:51.970859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:51.971130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] PATH_INFO: `/v3/users/2d21d3f4410f43e094769bfa21dcbfd9` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:51.984386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d3f4410f43e094769bfa21dcbfd9)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:51.985858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:51.987713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 515/1056] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:45:51 2022] GET /identity/v3/users/2d21d3f4410f43e094769bfa21dcbfd9 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:51.993511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:52.095031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf165d39-7b31-4f32-a867-beaf18c6ec55 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:52.126874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:52.127538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:52.127837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:52.128113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:52.195009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:52.196363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:52.293362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 542/1057] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:45:52.299294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:52.402610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03f4fc-9ffd-4786-8b69-a9d5e5d99e7a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:52.440324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034017-0a91-4c25-9a8d-484c1592cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:52.441250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034017-0a91-4c25-9a8d-484c1592cc90 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:52.441534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034017-0a91-4c25-9a8d-484c1592cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:52.441806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034017-0a91-4c25-9a8d-484c1592cc90 None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:52.443090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034017-0a91-4c25-9a8d-484c1592cc90 None admin] RBAC: Authorizing `identity:get_project(project_id=db78e363b76d4da6810675b623cec256)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:52.444542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034017-0a91-4c25-9a8d-484c1592cc90 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:52.451502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 516/1058] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:45:52 2022] GET /identity/v3/projects/db78e363b76d4da6810675b623cec256 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:52.454542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:52.517813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835295c-7b39-433e-9b6a-2bdc8b6f69e8 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:52.518099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835295c-7b39-433e-9b6a-2bdc8b6f69e8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:52.518379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835295c-7b39-433e-9b6a-2bdc8b6f69e8 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:52.519947 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 517/1059] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:52.524918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326181-70ae-44d5-9b52-13fc5a8a1275 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:52.525208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326181-70ae-44d5-9b52-13fc5a8a1275 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:52.525482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326181-70ae-44d5-9b52-13fc5a8a1275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:52.542343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8c326181-70ae-44d5-9b52-13fc5a8a1275 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:52.543542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8c326181-70ae-44d5-9b52-13fc5a8a1275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:52.549245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c163d-a87b-4b39-b876-7a4aed411249 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:52.582029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:52.582701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:52.582986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:52.583266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:52.584109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=db78e363b76d4da6810675b623cec256, user.id=2d21d3f4410f43e094769bfa21dcbfd9) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:52.584427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:52.585904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:52.591543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 543/1060] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:52 2022] GET /identity/v3/role_assignments?user.id=2d21d3f4410f43e094769bfa21dcbfd9&scope.project.id=db78e363b76d4da6810675b623cec256&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:52.611244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 518/1061] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:52.633643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:52.741089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cd94b-b0ff-42ee-b2f5-53316fba9bc8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:52.777990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:52.778672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:52.778956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:52.779265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:52.847209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:52.849029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:52.956789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 544/1062] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:45:52.960040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326181-70ae-44d5-9b52-13fc5a8a1275 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:53.066493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326181-70ae-44d5-9b52-13fc5a8a1275 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:53.104879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba072199-be69-4481-933f-71a713e1f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:53.105700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba072199-be69-4481-933f-71a713e1f897 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.105975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba072199-be69-4481-933f-71a713e1f897 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.106248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba072199-be69-4481-933f-71a713e1f897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.116283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba072199-be69-4481-933f-71a713e1f897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:53.117877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba072199-be69-4481-933f-71a713e1f897 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-ba072199-be69-4481-933f-71a713e1f897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:53.136271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:53.137479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:53.138465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:53.138465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:53.138465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:53.138465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:53.138465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 519/1063] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:53.144781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:53.161870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5507-ca84-4bff-b91e-40510acc2250 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.162180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5507-ca84-4bff-b91e-40510acc2250 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.162418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5507-ca84-4bff-b91e-40510acc2250 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.164060 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 520/1064] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:53.169125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76f829-0e61-467a-92e9-80be8b22104e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.169384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76f829-0e61-467a-92e9-80be8b22104e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.169670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76f829-0e61-467a-92e9-80be8b22104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.188630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ae76f829-0e61-467a-92e9-80be8b22104e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:53.189856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ae76f829-0e61-467a-92e9-80be8b22104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:53.251958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb1d02-d798-4d31-a8ce-7f7064a6ff04 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:53.264766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 521/1065] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:53.281645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76f829-0e61-467a-92e9-80be8b22104e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:53.286898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:53.287579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.287860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.288133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.288900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:53.289207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:53.290594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:53.302500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 545/1066] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:53.409631 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76f829-0e61-467a-92e9-80be8b22104e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:53.454364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:53.455217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.455503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.455743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.468030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:53.476533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:53.477814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:53.485562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 522/1067] 10.222.0.52 () {56 vars in 1120 bytes} [Tue May 10 18:45:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:53.486289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:53.590339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2042-0c93-4970-866a-ace6c5c957e4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:53.623967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:53.624643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.624962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.625228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.625987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:53.626294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:53.627658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:53.635943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 546/1068] 10.222.0.52 () {56 vars in 1115 bytes} [Tue May 10 18:45:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:53.643413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:53.749390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e4c20-8e64-4729-a7b7-4918bdc3072a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:53.790452 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:53.791360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.791634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.791944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.802987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:53.804433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:53.824482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:53.825486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:53.826400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:53.826400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:53.826400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:53.826400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:53.826400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 523/1069] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:53.832120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:53.941320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e457903-5e41-4414-a50c-5cec09ed6c38 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:53.974716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:53.975377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:53.975659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:53.975935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:53.976662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:53.976998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:53.978371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:53.990162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 547/1070] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:53.995920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:54.094281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11bb9-d450-47b4-af10-34bb00bb7f3b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:54.127250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:54.128039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.128320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.128592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.137423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:54.138845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:54.152614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:54.153648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:54.154611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 524/1071] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:45:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:54.159821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:54.261094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41469c-f970-48ab-a7f9-29aaea999891 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:54.295193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:54.295867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.296144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.296416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.297454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:54.297755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:54.299195 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:54.316658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 548/1072] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:45:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:54.322441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:54.423570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c8c8f-598b-4869-885f-42ed216af0b6 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:54.460586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:54.461445 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.461726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.461997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.472797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:54.474242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:54.491027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:54.492081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:54.493032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:54.493032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:54.493032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:54.493032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:54.493032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 525/1073] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:54.498228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:54.600956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc27806-688f-4b00-afa1-cbbece17e88c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:54.637401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:54.638068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.638346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.638621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.639349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:54.639659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:54.641076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:54.652298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 549/1074] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:54.658119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:54.765978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2328be-6634-4acd-9e1c-71fe943df2e6 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:54.799548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e403d00-c5fe-49a5-b274-0c6e85aa3068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:54.800371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403d00-c5fe-49a5-b274-0c6e85aa3068 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.800648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403d00-c5fe-49a5-b274-0c6e85aa3068 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.800974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403d00-c5fe-49a5-b274-0c6e85aa3068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.807787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e403d00-c5fe-49a5-b274-0c6e85aa3068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:54.809256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e403d00-c5fe-49a5-b274-0c6e85aa3068 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-9e403d00-c5fe-49a5-b274-0c6e85aa3068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:54.823380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:54.824306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:54.825247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 526/1075] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:54.830515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:54.862203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ca1f-46d2-4a71-a070-32469b43f71a None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.862465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ca1f-46d2-4a71-a070-32469b43f71a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.862778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ca1f-46d2-4a71-a070-32469b43f71a None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.864309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 527/1076] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:54.869055 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c0bd7-a97c-4402-8fbf-1e7f34cccd1f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.869334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c0bd7-a97c-4402-8fbf-1e7f34cccd1f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.869611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c0bd7-a97c-4402-8fbf-1e7f34cccd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.886582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-eb4c0bd7-a97c-4402-8fbf-1e7f34cccd1f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:54.887762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-eb4c0bd7-a97c-4402-8fbf-1e7f34cccd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:54.932093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e91e33-8808-4f31-9cbb-d67ca68253e5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:54.950942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 528/1077] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:54.964616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:54.965303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:54.965579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:54.965856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:54.966646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:54.966958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:54.968371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:54.974060 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c0bd7-a97c-4402-8fbf-1e7f34cccd1f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:54.980241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 550/1078] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:54.986088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:55.069634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c0bd7-a97c-4402-8fbf-1e7f34cccd1f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:55.079849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234900a5-7a0f-4b42-a02b-a68ec0b9b499 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:55.104049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:55.104935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:55.105217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:55.105485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:55.111555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:55.112444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:55.112761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:55.113036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/dff69f29cd4341f488887fea0dd2e540/roles/3dbd4cd0a19d4aaea323abe322569413` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:55.115280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=dff69f29cd4341f488887fea0dd2e540, role_id=3dbd4cd0a19d4aaea323abe322569413)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:55.115969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:55.116746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:55.123522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:55.124620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:55.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 529/1079] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:55.130059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 551/1080] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:45:54 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/dff69f29cd4341f488887fea0dd2e540/roles/3dbd4cd0a19d4aaea323abe322569413 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:45:55.134225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:55.249054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62198e-afc7-437f-9649-7b112e801e5d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:55.287859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:55.288556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:55.288875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:55.289152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:55.289906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:55.290214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:55.291630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:55.301067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 530/1081] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:55.307379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:55.409283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f36bb9-eb45-4919-9178-b5eaae0c62f5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:55.443977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:55.444895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:55.445175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:55.445449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] PATH_INFO: `/v3/users/2d21d3f4410f43e094769bfa21dcbfd9` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:55.446689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d3f4410f43e094769bfa21dcbfd9)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:55.448143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:55.450015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 552/1082] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:45:55 2022] GET /identity/v3/users/2d21d3f4410f43e094769bfa21dcbfd9 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:55.455679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:55.554740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e98b3-c14d-454c-99cc-5205b5951312 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:55.590937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e37c78-fb54-469a-83bc-11a57c10e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:55.591821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e37c78-fb54-469a-83bc-11a57c10e5cd None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:55.592094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e37c78-fb54-469a-83bc-11a57c10e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:55.592338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e37c78-fb54-469a-83bc-11a57c10e5cd None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:55.593634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e37c78-fb54-469a-83bc-11a57c10e5cd None admin] RBAC: Authorizing `identity:get_project(project_id=db78e363b76d4da6810675b623cec256)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:55.595076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e37c78-fb54-469a-83bc-11a57c10e5cd None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:55.596847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 531/1083] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:45:55 2022] GET /identity/v3/projects/db78e363b76d4da6810675b623cec256 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:55.602784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:55.708654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a5863-241c-430a-9a7e-9f5f8939a73c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:55.743452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757a5b-0032-4715-b049-f7ceee100092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:55.744351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757a5b-0032-4715-b049-f7ceee100092 None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:55.744635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757a5b-0032-4715-b049-f7ceee100092 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:55.744951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757a5b-0032-4715-b049-f7ceee100092 None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256/users/2d21d3f4410f43e094769bfa21dcbfd9/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:55.747101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757a5b-0032-4715-b049-f7ceee100092 None admin] RBAC: Authorizing `identity:create_grant(project_id=db78e363b76d4da6810675b623cec256, user_id=2d21d3f4410f43e094769bfa21dcbfd9, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:55.748549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757a5b-0032-4715-b049-f7ceee100092 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:55.763028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 553/1084] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:45:55 2022] PUT /identity/v3/projects/db78e363b76d4da6810675b623cec256/users/2d21d3f4410f43e094769bfa21dcbfd9/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:45:57.321221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667916-7854-4324-9144-1248e8e24464 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:57.321776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667916-7854-4324-9144-1248e8e24464 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:57.321776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667916-7854-4324-9144-1248e8e24464 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:57.323229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 532/1085] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:45:57.328781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862033-6531-4f1b-9374-82b7108a9009 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:57.329180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862033-6531-4f1b-9374-82b7108a9009 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:57.329367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862033-6531-4f1b-9374-82b7108a9009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:57.346818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-99862033-6531-4f1b-9374-82b7108a9009 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:57.348056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-99862033-6531-4f1b-9374-82b7108a9009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:57.415216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 554/1086] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:45:57.438910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667916-7854-4324-9144-1248e8e24464 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:57.541609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667916-7854-4324-9144-1248e8e24464 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:57.575628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:57.576375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:57.576657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:57.576958 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:57.586812 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:57.594935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:57.595894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:57.596797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 533/1087] 10.222.0.52 () {56 vars in 1120 bytes} [Tue May 10 18:45:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:57.602333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862033-6531-4f1b-9374-82b7108a9009 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:57.701711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862033-6531-4f1b-9374-82b7108a9009 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:57.735108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:57.735769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:57.736051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:57.736326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:57.737118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:57.737426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:57.738796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:57.746513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 555/1088] 10.222.0.52 () {56 vars in 1115 bytes} [Tue May 10 18:45:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:57.752599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:57.863255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2e84-3db4-4bf5-947b-75139677dbac None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:57.897277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee14ebd-b474-4a3f-beff-d0f9269430c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:57.898069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee14ebd-b474-4a3f-beff-d0f9269430c7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:57.898351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee14ebd-b474-4a3f-beff-d0f9269430c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:57.898625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee14ebd-b474-4a3f-beff-d0f9269430c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:57.909123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee14ebd-b474-4a3f-beff-d0f9269430c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:57.910569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee14ebd-b474-4a3f-beff-d0f9269430c7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-bee14ebd-b474-4a3f-beff-d0f9269430c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:57.931742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:57.932899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:57.933803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:57.933803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:57.933803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:57.933803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:57.935344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 534/1089] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:57.941273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:57.958568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a026fb-c2ef-4b00-857f-33268b7d7439 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:57.958855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a026fb-c2ef-4b00-857f-33268b7d7439 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:57.959138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a026fb-c2ef-4b00-857f-33268b7d7439 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:57.960520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 535/1090] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:45:57.966002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbef0d-9537-4cdb-850b-a0890f2f56aa None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:57.966258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbef0d-9537-4cdb-850b-a0890f2f56aa None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:57.966592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbef0d-9537-4cdb-850b-a0890f2f56aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:57.983478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-94fbef0d-9537-4cdb-850b-a0890f2f56aa None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:45:57.984705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-94fbef0d-9537-4cdb-850b-a0890f2f56aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:45:58.044175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da5772-338f-44bd-bda5-54ece31c0593 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.051189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 536/1091] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:45:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:45:58.074170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbef0d-9537-4cdb-850b-a0890f2f56aa None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.076427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.077828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.078100 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.078376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.079113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:58.079420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.080836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.092781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 556/1092] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:58.098383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.166978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbef0d-9537-4cdb-850b-a0890f2f56aa None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.196559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c0f3f-3fae-4f07-a7df-a40738c12a39 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.199401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.200192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.200471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.200839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.210709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:45:58.218331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:58.219259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:45:58.220094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 537/1093] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:58.225707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.228888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.229787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.230068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.230343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.237443 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.238885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:45:58.253024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:58.254106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:58.255066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 557/1094] 10.222.0.52 () {56 vars in 1093 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:58.260241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.322385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e9951-fd4b-44a9-b752-ab67351dce84 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.355343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.356013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.356296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.356573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.357356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:58.357662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.357755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce77d91-9f98-4534-a788-3b46244cfef3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.359057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.367006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 538/1095] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:58.372886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.390856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.391610 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.391892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.392143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.393024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:58.393330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.394749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.411385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 558/1096] 10.222.0.52 () {56 vars in 1133 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:58.417072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.467801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786bfa-c76c-495f-b06d-d98afe691992 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.501684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.502587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.502897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.503166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] PATH_INFO: `/v3/users/2d21d3f4410f43e094769bfa21dcbfd9` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.504391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] RBAC: Authorizing `identity:get_user(user_id=2d21d3f4410f43e094769bfa21dcbfd9)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.505887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.507518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 539/1097] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/users/2d21d3f4410f43e094769bfa21dcbfd9 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:58.511227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed53d1-f1a5-41bf-bb7f-c8e1bc1fdc94 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.513737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.544255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.544951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.545235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.545506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.608214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a87b3-17c9-4e67-839c-12d4847b9d70 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.621661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.623117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.641921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.642568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.642853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.643128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.704912 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.706271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.721311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 559/1098] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 18:45:58.727089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.800615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 540/1099] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:45:58.806474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.823566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82290f1c-d0ce-4ead-99dd-3d10c821e6d7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.856314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.857150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.857454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.857715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.867411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.868894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:45:58.885928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:58.887021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:58.888402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:45:58.888402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:45:58.888402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:45:58.888402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:58.888402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 560/1100] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:45:58.892775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.903518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe421dc-d791-4726-85b7-4a009b9c86e9 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:58.934562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:58.935405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:58.935677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:58.935944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:58.937246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=db78e363b76d4da6810675b623cec256)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:58.938572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:58.940270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 541/1101] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/projects/db78e363b76d4da6810675b623cec256 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:58.946208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:58.988921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3af71-27d4-485e-aa1a-4b61c993bbfc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:59.023426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:59.024097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:59.024377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:59.024649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:59.025416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:59.025719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:59.027085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:59.038850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 561/1102] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:59.039147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eeed8-381a-4daf-b871-0e41787ed3f0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:59.044480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:59.071067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:59.071711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:59.071986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:59.072250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:59.073142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=db78e363b76d4da6810675b623cec256, user.id=2d21d3f4410f43e094769bfa21dcbfd9) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:59.073448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:59.074879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:59.080955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 542/1103] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:58 2022] GET /identity/v3/role_assignments?user.id=2d21d3f4410f43e094769bfa21dcbfd9&scope.project.id=db78e363b76d4da6810675b623cec256&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:45:59.148977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c47de-0f17-494f-9745-297f5fe639ca None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:59.186023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:59.186844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:59.187127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:59.187401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:59.195036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:59.196490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:45:59.211731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:45:59.212790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:45:59.214153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 562/1104] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:45:59.219503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:59.319617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c283-8cc7-4188-8368-7de95b0ca914 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:59.357900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2fbd-1a80-4bba-b672-cfc0e234ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:59.358556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2fbd-1a80-4bba-b672-cfc0e234ac91 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:59.358836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2fbd-1a80-4bba-b672-cfc0e234ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:59.359117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2fbd-1a80-4bba-b672-cfc0e234ac91 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:59.359910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf2fbd-1a80-4bba-b672-cfc0e234ac91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:59.360223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf2fbd-1a80-4bba-b672-cfc0e234ac91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:59.361689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf2fbd-1a80-4bba-b672-cfc0e234ac91 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:59.373536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 543/1105] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:45:59.380027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:45:59.477930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe24b-162d-431f-a3c6-232131eb8c7e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:45:59.513271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9309-c0ab-4668-8eba-28f36e90a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:45:59.513940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9309-c0ab-4668-8eba-28f36e90a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:45:59.514224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9309-c0ab-4668-8eba-28f36e90a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:45:59.514504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9309-c0ab-4668-8eba-28f36e90a8c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:45:59.515342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9309-c0ab-4668-8eba-28f36e90a8c5 None admin] RBAC: Adding query filter params (role.id=3dbd4cd0a19d4aaea323abe322569413, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=dff69f29cd4341f488887fea0dd2e540) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:45:59.515659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9309-c0ab-4668-8eba-28f36e90a8c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:45:59.517128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9309-c0ab-4668-8eba-28f36e90a8c5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:45:59.522897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 563/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:45:59 2022] GET /identity/v3/role_assignments?user.id=dff69f29cd4341f488887fea0dd2e540&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=3dbd4cd0a19d4aaea323abe322569413 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:01.315613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c537-2b27-4e8e-ad0c-e59f502d3f03 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:01.316606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c537-2b27-4e8e-ad0c-e59f502d3f03 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:01.316606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c537-2b27-4e8e-ad0c-e59f502d3f03 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:01.318751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 544/1107] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:01.324607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e63773-fe4e-489f-b31b-d6b090d044c4 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:01.325079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e63773-fe4e-489f-b31b-d6b090d044c4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:01.325414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e63773-fe4e-489f-b31b-d6b090d044c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:01.353230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b2e63773-fe4e-489f-b31b-d6b090d044c4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:01.354782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b2e63773-fe4e-489f-b31b-d6b090d044c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:01.421619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 564/1108] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:01.449377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c537-2b27-4e8e-ad0c-e59f502d3f03 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:01.552875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c537-2b27-4e8e-ad0c-e59f502d3f03 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:01.586828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b769f6-2791-4370-bd04-8f871fecbd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:01.587553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b769f6-2791-4370-bd04-8f871fecbd11 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:01.587831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b769f6-2791-4370-bd04-8f871fecbd11 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:01.588109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b769f6-2791-4370-bd04-8f871fecbd11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:01.589511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b769f6-2791-4370-bd04-8f871fecbd11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:01.590949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b769f6-2791-4370-bd04-8f871fecbd11 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:01.592573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 545/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:46:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:01.601165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e63773-fe4e-489f-b31b-d6b090d044c4 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:01.698096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e63773-fe4e-489f-b31b-d6b090d044c4 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:01.736159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419059d-a6cc-4f85-a2b3-b678dc7625cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:01.736846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419059d-a6cc-4f85-a2b3-b678dc7625cb None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:01.737127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419059d-a6cc-4f85-a2b3-b678dc7625cb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:01.737401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419059d-a6cc-4f85-a2b3-b678dc7625cb None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:01.738116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419059d-a6cc-4f85-a2b3-b678dc7625cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:01.739544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419059d-a6cc-4f85-a2b3-b678dc7625cb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:01.763351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 565/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:46:01 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:46:03.991711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57013d-3727-4124-9880-96b42fadeedc None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:03.992613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57013d-3727-4124-9880-96b42fadeedc None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:03.992613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57013d-3727-4124-9880-96b42fadeedc None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:03.994860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 546/1111] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:04.006305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90735e-c095-465b-8fd9-989b06be9876 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:04.006725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90735e-c095-465b-8fd9-989b06be9876 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:04.006879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90735e-c095-465b-8fd9-989b06be9876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:04.026408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-9d90735e-c095-465b-8fd9-989b06be9876 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:04.027612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9d90735e-c095-465b-8fd9-989b06be9876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:04.093953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 566/1112] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:04.121506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57013d-3727-4124-9880-96b42fadeedc None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:04.239459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57013d-3727-4124-9880-96b42fadeedc None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:04.275821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:04.276634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:04.276944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:04.277216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] PATH_INFO: `/v3/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:04.278825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] RBAC: Authorizing `identity:get_role(role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:04.280199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:04.281616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 547/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:04 2022] GET /identity/v3/roles/08dee391f7e34431ad610ccbb9b49349 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:04.287653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90735e-c095-465b-8fd9-989b06be9876 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:04.394780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90735e-c095-465b-8fd9-989b06be9876 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:04.436444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:04.437357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:04.437635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:04.437908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] PATH_INFO: `/v3/users/c4a76792feb347b98c87b55bb48237ee` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:04.452225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=c4a76792feb347b98c87b55bb48237ee)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:04.453707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:04.455387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 567/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:04 2022] GET /identity/v3/users/c4a76792feb347b98c87b55bb48237ee => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:04.461569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:04.565071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21fba-e041-4cf4-9636-0b45a0193e18 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:04.598987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:04.599626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:04.599904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:04.600178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:04.665666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:04.667126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:04.763053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 548/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:46:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:46:04.769941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:04.879812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39be5aa-2b6a-4df4-b700-210ee3a92cf8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:04.913960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ea31a-153e-4fa6-979d-dabe97036663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:04.914813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ea31a-153e-4fa6-979d-dabe97036663 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:04.915094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ea31a-153e-4fa6-979d-dabe97036663 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:04.915373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ea31a-153e-4fa6-979d-dabe97036663 None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:04.916660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ea31a-153e-4fa6-979d-dabe97036663 None admin] RBAC: Authorizing `identity:get_project(project_id=db78e363b76d4da6810675b623cec256)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:04.918125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ea31a-153e-4fa6-979d-dabe97036663 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:04.919803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 568/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:04 2022] GET /identity/v3/projects/db78e363b76d4da6810675b623cec256 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:04.929668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:05.045809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721671-2467-4aec-868b-998b93d0bc0a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:05.080545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e6840-8453-4468-b5b9-2631b783c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:05.081224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6840-8453-4468-b5b9-2631b783c568 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:05.081509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6840-8453-4468-b5b9-2631b783c568 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:05.081776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6840-8453-4468-b5b9-2631b783c568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:05.082643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e6840-8453-4468-b5b9-2631b783c568 None admin] RBAC: Adding query filter params (role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=db78e363b76d4da6810675b623cec256, user.id=c4a76792feb347b98c87b55bb48237ee) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:05.082956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e6840-8453-4468-b5b9-2631b783c568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:05.084351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e6840-8453-4468-b5b9-2631b783c568 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:05.089921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 549/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:46:04 2022] GET /identity/v3/role_assignments?user.id=c4a76792feb347b98c87b55bb48237ee&scope.project.id=db78e363b76d4da6810675b623cec256&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:07.293890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e41e-540a-4a3d-9747-f003f2ad2ae4 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:07.294482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e41e-540a-4a3d-9747-f003f2ad2ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:07.294482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e41e-540a-4a3d-9747-f003f2ad2ae4 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:07.295840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 569/1118] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:07.301352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f0a7-67a6-4d45-8906-0de302cf8ada None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:07.301792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f0a7-67a6-4d45-8906-0de302cf8ada None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:07.301885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f0a7-67a6-4d45-8906-0de302cf8ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:07.320560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7bb7f0a7-67a6-4d45-8906-0de302cf8ada None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:07.321793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7bb7f0a7-67a6-4d45-8906-0de302cf8ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:07.387541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 550/1119] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:07.413962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34e41e-540a-4a3d-9747-f003f2ad2ae4 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:07.526554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34e41e-540a-4a3d-9747-f003f2ad2ae4 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:07.560970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:07.561749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:07.562029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:07.562299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] PATH_INFO: `/v3/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:07.563827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] RBAC: Authorizing `identity:get_role(role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:07.565230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:07.566593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 570/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:07 2022] GET /identity/v3/roles/08dee391f7e34431ad610ccbb9b49349 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:07.576077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f0a7-67a6-4d45-8906-0de302cf8ada None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:07.688403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f0a7-67a6-4d45-8906-0de302cf8ada None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:07.722365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682542-5135-457c-82b9-03815a978875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:07.723229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682542-5135-457c-82b9-03815a978875 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:07.723507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682542-5135-457c-82b9-03815a978875 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:07.723785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682542-5135-457c-82b9-03815a978875 None admin] PATH_INFO: `/v3/users/c4a76792feb347b98c87b55bb48237ee` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:07.725127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682542-5135-457c-82b9-03815a978875 None admin] RBAC: Authorizing `identity:get_user(user_id=c4a76792feb347b98c87b55bb48237ee)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:07.726570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682542-5135-457c-82b9-03815a978875 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:07.728217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 551/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:07 2022] GET /identity/v3/users/c4a76792feb347b98c87b55bb48237ee => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:07.736940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:07.837840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744e9af-8374-481b-9a01-651c8beec1f7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:07.871456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dd275-4cdb-43be-ab0d-fe8cc39f6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:07.872287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd275-4cdb-43be-ab0d-fe8cc39f6644 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:07.872564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd275-4cdb-43be-ab0d-fe8cc39f6644 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:07.872861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dd275-4cdb-43be-ab0d-fe8cc39f6644 None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:07.874104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dd275-4cdb-43be-ab0d-fe8cc39f6644 None admin] RBAC: Authorizing `identity:get_project(project_id=db78e363b76d4da6810675b623cec256)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:07.875523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dd275-4cdb-43be-ab0d-fe8cc39f6644 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:07.877223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 571/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:07 2022] GET /identity/v3/projects/db78e363b76d4da6810675b623cec256 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:07.883355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682542-5135-457c-82b9-03815a978875 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:07.984931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682542-5135-457c-82b9-03815a978875 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:08.019201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20150312-4cae-47b9-8b29-092eca81e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:08.020078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150312-4cae-47b9-8b29-092eca81e713 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:08.020359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150312-4cae-47b9-8b29-092eca81e713 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:08.020636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150312-4cae-47b9-8b29-092eca81e713 None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256/users/c4a76792feb347b98c87b55bb48237ee/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:08.023263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20150312-4cae-47b9-8b29-092eca81e713 None admin] RBAC: Authorizing `identity:create_grant(project_id=db78e363b76d4da6810675b623cec256, user_id=c4a76792feb347b98c87b55bb48237ee, role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:08.024721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20150312-4cae-47b9-8b29-092eca81e713 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:08.042638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 552/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:46:07 2022] PUT /identity/v3/projects/db78e363b76d4da6810675b623cec256/users/c4a76792feb347b98c87b55bb48237ee/roles/08dee391f7e34431ad610ccbb9b49349 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:46:10.213615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57006aa-b6da-4738-9d75-9ada1c4c4986 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:10.214166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57006aa-b6da-4738-9d75-9ada1c4c4986 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:10.214166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57006aa-b6da-4738-9d75-9ada1c4c4986 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:10.215545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 572/1124] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:10.221288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc627d-1c56-4138-98be-84549a06888a None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:10.221673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc627d-1c56-4138-98be-84549a06888a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:10.221852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc627d-1c56-4138-98be-84549a06888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:10.239768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b4cc627d-1c56-4138-98be-84549a06888a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:10.241009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b4cc627d-1c56-4138-98be-84549a06888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:10.311209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 553/1125] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:10.339720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57006aa-b6da-4738-9d75-9ada1c4c4986 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:10.456918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57006aa-b6da-4738-9d75-9ada1c4c4986 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:10.495498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:10.496290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:10.496574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:10.496891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] PATH_INFO: `/v3/roles/08dee391f7e34431ad610ccbb9b49349` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:10.498429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] RBAC: Authorizing `identity:get_role(role_id=08dee391f7e34431ad610ccbb9b49349)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:10.499795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:10.501234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 573/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:10 2022] GET /identity/v3/roles/08dee391f7e34431ad610ccbb9b49349 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:10.510365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc627d-1c56-4138-98be-84549a06888a None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:10.610110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc627d-1c56-4138-98be-84549a06888a None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:10.644231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:10.645135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:10.645410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:10.645684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] PATH_INFO: `/v3/users/c4a76792feb347b98c87b55bb48237ee` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:10.646994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] RBAC: Authorizing `identity:get_user(user_id=c4a76792feb347b98c87b55bb48237ee)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:10.648448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:10.650088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 554/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:10 2022] GET /identity/v3/users/c4a76792feb347b98c87b55bb48237ee => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:10.658727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:10.762875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4bfe4-bbf4-42c0-9152-9736d113f9b1 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:10.796341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:10.797013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:10.797292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:10.797569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:10.862774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:10.864200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:10.975914 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 574/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:46:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 18:46:10.985153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:11.101875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8301-b74b-4ad0-9469-5a87b2f752aa None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:11.143737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae4060-662e-4695-9d69-c00e55ddf84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:11.144593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4060-662e-4695-9d69-c00e55ddf84e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:11.144908 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4060-662e-4695-9d69-c00e55ddf84e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:11.145180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4060-662e-4695-9d69-c00e55ddf84e None admin] PATH_INFO: `/v3/projects/db78e363b76d4da6810675b623cec256` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:11.146420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae4060-662e-4695-9d69-c00e55ddf84e None admin] RBAC: Authorizing `identity:get_project(project_id=db78e363b76d4da6810675b623cec256)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:11.147862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae4060-662e-4695-9d69-c00e55ddf84e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:11.149614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 555/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:10 2022] GET /identity/v3/projects/db78e363b76d4da6810675b623cec256 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:11.155983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:11.276284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eae6f-367e-4b1d-aea0-c94301c125a9 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:11.324300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7ed8b-cc14-4db8-87d2-15a9fc5a88a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:11.325276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7ed8b-cc14-4db8-87d2-15a9fc5a88a8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:11.325654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7ed8b-cc14-4db8-87d2-15a9fc5a88a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:11.325999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7ed8b-cc14-4db8-87d2-15a9fc5a88a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:11.327277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7ed8b-cc14-4db8-87d2-15a9fc5a88a8 None admin] RBAC: Adding query filter params (role.id=08dee391f7e34431ad610ccbb9b49349, scope.project.id=db78e363b76d4da6810675b623cec256, user.id=c4a76792feb347b98c87b55bb48237ee) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:11.327717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7ed8b-cc14-4db8-87d2-15a9fc5a88a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:11.329997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7ed8b-cc14-4db8-87d2-15a9fc5a88a8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:11.339353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 575/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:46:11 2022] GET /identity/v3/role_assignments?user.id=c4a76792feb347b98c87b55bb48237ee&scope.project.id=db78e363b76d4da6810675b623cec256&role.id=08dee391f7e34431ad610ccbb9b49349 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:13.585861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3e01-a32f-4656-94d3-1100859cf6d9 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:13.586720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3e01-a32f-4656-94d3-1100859cf6d9 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:13.586720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3e01-a32f-4656-94d3-1100859cf6d9 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:13.588626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 556/1131] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:13.596720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2755c4-1d4c-427e-8c27-2b1967509293 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:13.597181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2755c4-1d4c-427e-8c27-2b1967509293 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:13.597289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2755c4-1d4c-427e-8c27-2b1967509293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:13.616282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3f2755c4-1d4c-427e-8c27-2b1967509293 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:13.617509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3f2755c4-1d4c-427e-8c27-2b1967509293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:13.686375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 576/1132] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:46:13.717324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3e01-a32f-4656-94d3-1100859cf6d9 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:13.830796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3e01-a32f-4656-94d3-1100859cf6d9 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:13.866695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab7de2-07ec-46e1-b8ee-447c61f81988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:13.867470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7de2-07ec-46e1-b8ee-447c61f81988 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:13.867744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7de2-07ec-46e1-b8ee-447c61f81988 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:13.868012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7de2-07ec-46e1-b8ee-447c61f81988 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:13.869360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab7de2-07ec-46e1-b8ee-447c61f81988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:13.870780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab7de2-07ec-46e1-b8ee-447c61f81988 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:13.872362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 557/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:46:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:13.878250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2755c4-1d4c-427e-8c27-2b1967509293 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:13.987370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2755c4-1d4c-427e-8c27-2b1967509293 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:14.021630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dcb15-22db-48cd-9171-374110c7020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:14.022280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dcb15-22db-48cd-9171-374110c7020c None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:14.022565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dcb15-22db-48cd-9171-374110c7020c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:14.022839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dcb15-22db-48cd-9171-374110c7020c None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:14.023542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dcb15-22db-48cd-9171-374110c7020c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:14.024983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dcb15-22db-48cd-9171-374110c7020c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:14.053423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 577/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:46:13 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:46:16.309359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46216-5bd5-4493-916c-bf40b3912cfd None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:16.309953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46216-5bd5-4493-916c-bf40b3912cfd None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:16.309953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46216-5bd5-4493-916c-bf40b3912cfd None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:16.311968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 558/1135] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:16.318146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804bc02-a503-4f39-a8f0-5b7d16143061 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:16.318567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804bc02-a503-4f39-a8f0-5b7d16143061 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:16.318716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804bc02-a503-4f39-a8f0-5b7d16143061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:16.337658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2804bc02-a503-4f39-a8f0-5b7d16143061 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:16.338848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2804bc02-a503-4f39-a8f0-5b7d16143061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:16.405075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 578/1136] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:16.429606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46216-5bd5-4493-916c-bf40b3912cfd None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:16.551204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46216-5bd5-4493-916c-bf40b3912cfd None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:16.584929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43096d-eb02-41f6-b83f-e7a2d66bd2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:16.585654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43096d-eb02-41f6-b83f-e7a2d66bd2c9 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:16.585933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43096d-eb02-41f6-b83f-e7a2d66bd2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:16.586204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43096d-eb02-41f6-b83f-e7a2d66bd2c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:16.587441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43096d-eb02-41f6-b83f-e7a2d66bd2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:16.588991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43096d-eb02-41f6-b83f-e7a2d66bd2c9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:16.590623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 559/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:46:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:16.596802 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804bc02-a503-4f39-a8f0-5b7d16143061 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:16.698075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804bc02-a503-4f39-a8f0-5b7d16143061 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:16.735788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477009d-f31f-4ab4-836c-1da1062f64ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:16.736451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477009d-f31f-4ab4-836c-1da1062f64ea None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:16.736763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477009d-f31f-4ab4-836c-1da1062f64ea None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:16.737042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477009d-f31f-4ab4-836c-1da1062f64ea None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:16.737759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477009d-f31f-4ab4-836c-1da1062f64ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:16.739194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477009d-f31f-4ab4-836c-1da1062f64ea None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:16.765818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 579/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:46:16 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:46:19.027479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012187-10c6-4bec-bdfb-2be6a538db01 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:19.028386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012187-10c6-4bec-bdfb-2be6a538db01 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:19.028386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012187-10c6-4bec-bdfb-2be6a538db01 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:19.030639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 560/1139] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:19.036475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454af88-6f37-44ff-b25d-eafd72327a9a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:19.036951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454af88-6f37-44ff-b25d-eafd72327a9a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:19.037054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454af88-6f37-44ff-b25d-eafd72327a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:19.056320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0454af88-6f37-44ff-b25d-eafd72327a9a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:19.057542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0454af88-6f37-44ff-b25d-eafd72327a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:19.125732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 580/1140] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:19.150289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012187-10c6-4bec-bdfb-2be6a538db01 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:19.263305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012187-10c6-4bec-bdfb-2be6a538db01 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:19.297432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:19.298154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:19.298430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:19.298702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:19.308834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:46:19.316388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:46:19.317592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:46:19.318516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 561/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:46:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:46:19.325056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454af88-6f37-44ff-b25d-eafd72327a9a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:19.440716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454af88-6f37-44ff-b25d-eafd72327a9a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:19.481963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:19.482635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:19.482917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:19.483186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:19.483948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:19.484256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:19.485661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:19.493824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 581/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:19.502497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:19.607486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddefa6-fbbb-40b7-94d4-04bce2440f85 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:19.641177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:19.642040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:19.642319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:19.642595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] PATH_INFO: `/v3/users/3475610793fc415fabb8e2ba11d9d196` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:19.656469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] RBAC: Authorizing `identity:get_user(user_id=3475610793fc415fabb8e2ba11d9d196)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:19.657963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:19.659612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 562/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:19 2022] GET /identity/v3/users/3475610793fc415fabb8e2ba11d9d196 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:19.665612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:19.766552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ec91-8626-440c-9dfc-ce5ddd22a97e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:19.800357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:19.801034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:19.801295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:19.801596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:19.872092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:19.873511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:19.980699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 582/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:46:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 18:46:19.987519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:20.104997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e5e91-bcb9-4560-b665-c73b51351d80 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:20.142973 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21db28-9f2a-41de-9d8d-815efe6fa847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:20.143771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21db28-9f2a-41de-9d8d-815efe6fa847 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:20.144053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21db28-9f2a-41de-9d8d-815efe6fa847 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:20.144327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21db28-9f2a-41de-9d8d-815efe6fa847 None admin] PATH_INFO: `/v3/projects/96dc7189d5d146a78bca27ebed19e2cb` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:20.145590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21db28-9f2a-41de-9d8d-815efe6fa847 None admin] RBAC: Authorizing `identity:get_project(project_id=96dc7189d5d146a78bca27ebed19e2cb)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:20.147060 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21db28-9f2a-41de-9d8d-815efe6fa847 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:20.148818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 563/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:19 2022] GET /identity/v3/projects/96dc7189d5d146a78bca27ebed19e2cb => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:20.155234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:20.252085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81adeb6-97ee-4781-ad77-67e19db785fb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:20.286378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be582ae-793b-4cea-bb3d-b12b317bb35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:20.287026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be582ae-793b-4cea-bb3d-b12b317bb35f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:20.287308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be582ae-793b-4cea-bb3d-b12b317bb35f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:20.287563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be582ae-793b-4cea-bb3d-b12b317bb35f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:20.288393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be582ae-793b-4cea-bb3d-b12b317bb35f None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=96dc7189d5d146a78bca27ebed19e2cb, user.id=3475610793fc415fabb8e2ba11d9d196) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:20.288719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be582ae-793b-4cea-bb3d-b12b317bb35f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:20.290159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be582ae-793b-4cea-bb3d-b12b317bb35f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:20.295589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 583/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:46:20 2022] GET /identity/v3/role_assignments?user.id=3475610793fc415fabb8e2ba11d9d196&scope.project.id=96dc7189d5d146a78bca27ebed19e2cb&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:22.461271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12eaf-8c8a-42fe-b05a-1b05e92248ad None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:22.461764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12eaf-8c8a-42fe-b05a-1b05e92248ad None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:22.461764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12eaf-8c8a-42fe-b05a-1b05e92248ad None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:22.463358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 564/1147] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:22.469677 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3eef7-abb0-434b-bb46-32ffe6b2fcfc None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:22.470366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3eef7-abb0-434b-bb46-32ffe6b2fcfc None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:22.470467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3eef7-abb0-434b-bb46-32ffe6b2fcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:22.496091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2ab3eef7-abb0-434b-bb46-32ffe6b2fcfc None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:22.497317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2ab3eef7-abb0-434b-bb46-32ffe6b2fcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:22.567405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 584/1148] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:22.590441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12eaf-8c8a-42fe-b05a-1b05e92248ad None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:22.696507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12eaf-8c8a-42fe-b05a-1b05e92248ad None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:22.730957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:22.731673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:22.731953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:22.732225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:22.742785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:46:22.750523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:46:22.751558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:46:22.752799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 565/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:46:22.760972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3eef7-abb0-434b-bb46-32ffe6b2fcfc None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:22.858334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3eef7-abb0-434b-bb46-32ffe6b2fcfc None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:22.895968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:22.896629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:22.896948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:22.897218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:22.897979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:22.898291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:22.899660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:22.907661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 585/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:46:22.916551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:23.016602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009e5a3-aa75-4fb1-931d-98d542bda6de None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:23.049801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:23.050652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:23.050925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:23.051190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] PATH_INFO: `/v3/users/3475610793fc415fabb8e2ba11d9d196` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:23.052481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] RBAC: Authorizing `identity:get_user(user_id=3475610793fc415fabb8e2ba11d9d196)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:23.053944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:23.055570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 566/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:22 2022] GET /identity/v3/users/3475610793fc415fabb8e2ba11d9d196 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:23.062984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:23.169479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1c62-d6f5-4867-90b7-9f196e472499 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:23.203181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171b730-65d2-481e-89b6-b40d8e45d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:23.204037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171b730-65d2-481e-89b6-b40d8e45d419 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:23.204318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171b730-65d2-481e-89b6-b40d8e45d419 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:23.204592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171b730-65d2-481e-89b6-b40d8e45d419 None admin] PATH_INFO: `/v3/projects/96dc7189d5d146a78bca27ebed19e2cb` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:23.205946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171b730-65d2-481e-89b6-b40d8e45d419 None admin] RBAC: Authorizing `identity:get_project(project_id=96dc7189d5d146a78bca27ebed19e2cb)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:23.207371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171b730-65d2-481e-89b6-b40d8e45d419 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:23.209096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 586/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:23 2022] GET /identity/v3/projects/96dc7189d5d146a78bca27ebed19e2cb => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:23.215938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:23.340173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49481f6c-c64b-4549-83e2-ad5a26f778c5 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:23.375783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1861a-44c3-4379-8ffe-13c4ae82b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:23.376712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1861a-44c3-4379-8ffe-13c4ae82b04c None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:23.376936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1861a-44c3-4379-8ffe-13c4ae82b04c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:23.377247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1861a-44c3-4379-8ffe-13c4ae82b04c None admin] PATH_INFO: `/v3/projects/96dc7189d5d146a78bca27ebed19e2cb/users/3475610793fc415fabb8e2ba11d9d196/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:23.379351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1861a-44c3-4379-8ffe-13c4ae82b04c None admin] RBAC: Authorizing `identity:create_grant(project_id=96dc7189d5d146a78bca27ebed19e2cb, user_id=3475610793fc415fabb8e2ba11d9d196, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:23.380816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1861a-44c3-4379-8ffe-13c4ae82b04c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:23.402334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 567/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:46:23 2022] PUT /identity/v3/projects/96dc7189d5d146a78bca27ebed19e2cb/users/3475610793fc415fabb8e2ba11d9d196/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:46:25.590322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a34414-0c1e-4393-986b-0a5e78eba045 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:25.591147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a34414-0c1e-4393-986b-0a5e78eba045 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:25.591147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a34414-0c1e-4393-986b-0a5e78eba045 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:25.593389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 587/1154] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:25.599718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f618-e94c-4523-a7f2-cd7eaec7ec2f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:25.600167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f618-e94c-4523-a7f2-cd7eaec7ec2f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:25.600297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f618-e94c-4523-a7f2-cd7eaec7ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:25.623937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-39e3f618-e94c-4523-a7f2-cd7eaec7ec2f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:25.625190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-39e3f618-e94c-4523-a7f2-cd7eaec7ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:25.695385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 568/1155] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:25.719019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a34414-0c1e-4393-986b-0a5e78eba045 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:25.835349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a34414-0c1e-4393-986b-0a5e78eba045 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:25.872296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:25.873108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:25.873391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:25.873660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:25.885440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:46:25.892922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:46:25.894011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:46:25.894966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 588/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:46:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:46:25.900465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f618-e94c-4523-a7f2-cd7eaec7ec2f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:26.000458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f618-e94c-4523-a7f2-cd7eaec7ec2f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:26.034665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:26.035322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:26.035594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:26.035864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:26.036611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:26.036942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:26.038312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:26.046348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 569/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:46:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:26.052838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:26.158923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f168ce2-99aa-4365-a309-16e531a99706 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:26.193569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:26.194429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:26.194707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:26.194976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] PATH_INFO: `/v3/users/3475610793fc415fabb8e2ba11d9d196` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:26.196216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] RBAC: Authorizing `identity:get_user(user_id=3475610793fc415fabb8e2ba11d9d196)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:26.197706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:26.199346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 589/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:26 2022] GET /identity/v3/users/3475610793fc415fabb8e2ba11d9d196 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:26.205515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:26.301999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee726fa4-514b-45b2-8627-3be1e353e950 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:26.335294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:26.335938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:26.336223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:26.336500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:26.402521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:26.403964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:26.500026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 570/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:46:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:46:26.506907 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:26.621808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8de902-9190-48b2-86c1-d56777d429ae None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:26.655676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18a3d3-d477-4b1e-a199-aef4583bcc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:26.656523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a3d3-d477-4b1e-a199-aef4583bcc68 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:26.656833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a3d3-d477-4b1e-a199-aef4583bcc68 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:26.657107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a3d3-d477-4b1e-a199-aef4583bcc68 None admin] PATH_INFO: `/v3/projects/96dc7189d5d146a78bca27ebed19e2cb` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:26.658339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a3d3-d477-4b1e-a199-aef4583bcc68 None admin] RBAC: Authorizing `identity:get_project(project_id=96dc7189d5d146a78bca27ebed19e2cb)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:26.659770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a3d3-d477-4b1e-a199-aef4583bcc68 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:26.661492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 590/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:26 2022] GET /identity/v3/projects/96dc7189d5d146a78bca27ebed19e2cb => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:26.668226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:26.772083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0f741-bb7b-44f4-a4ae-b255c529f243 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:26.807927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4050fa-3794-499c-9703-dc49157ab35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:26.808587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4050fa-3794-499c-9703-dc49157ab35e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:26.808899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4050fa-3794-499c-9703-dc49157ab35e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:26.809176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4050fa-3794-499c-9703-dc49157ab35e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:26.810008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4050fa-3794-499c-9703-dc49157ab35e None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=96dc7189d5d146a78bca27ebed19e2cb, user.id=3475610793fc415fabb8e2ba11d9d196) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:26.810323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4050fa-3794-499c-9703-dc49157ab35e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:26.811754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4050fa-3794-499c-9703-dc49157ab35e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:26.818156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 571/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:46:26 2022] GET /identity/v3/role_assignments?user.id=3475610793fc415fabb8e2ba11d9d196&scope.project.id=96dc7189d5d146a78bca27ebed19e2cb&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:29.068043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d278-cd09-4bd0-8966-ecceefc17a8a None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:29.068912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d278-cd09-4bd0-8966-ecceefc17a8a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:29.068912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d278-cd09-4bd0-8966-ecceefc17a8a None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:29.071041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 591/1162] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:29.076862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d93ba-1b87-4386-a0f9-da7e24de2f7d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:29.077301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d93ba-1b87-4386-a0f9-da7e24de2f7d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:29.077405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d93ba-1b87-4386-a0f9-da7e24de2f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:29.096564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4f9d93ba-1b87-4386-a0f9-da7e24de2f7d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:29.097782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4f9d93ba-1b87-4386-a0f9-da7e24de2f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:29.166105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 572/1163] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:29.203811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d278-cd09-4bd0-8966-ecceefc17a8a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:29.323678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d278-cd09-4bd0-8966-ecceefc17a8a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:29.358776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:29.359412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:29.359689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:29.359961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:29.425687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:29.427580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:29.530097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 592/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:46:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:46:29.537354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d93ba-1b87-4386-a0f9-da7e24de2f7d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:29.637003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d93ba-1b87-4386-a0f9-da7e24de2f7d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:29.670955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59ebb7-4165-405d-a89e-f9920fa4d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:29.671750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59ebb7-4165-405d-a89e-f9920fa4d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:29.672026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59ebb7-4165-405d-a89e-f9920fa4d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:29.672309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59ebb7-4165-405d-a89e-f9920fa4d9d7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:29.679240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59ebb7-4165-405d-a89e-f9920fa4d9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:29.680713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59ebb7-4165-405d-a89e-f9920fa4d9d7 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-dd59ebb7-4165-405d-a89e-f9920fa4d9d7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:46:29.694699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:46:29.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:46:29.697050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 573/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:46:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:46:29.704369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:29.821358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce24e9-cbef-4e43-afaf-6d0522c1c986 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:29.855945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54511a27-1f10-4ade-924b-8bca28ce7de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:29.856593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511a27-1f10-4ade-924b-8bca28ce7de1 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:29.856925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511a27-1f10-4ade-924b-8bca28ce7de1 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:29.857200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511a27-1f10-4ade-924b-8bca28ce7de1 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:29.857936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511a27-1f10-4ade-924b-8bca28ce7de1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:29.858246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511a27-1f10-4ade-924b-8bca28ce7de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:29.859614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511a27-1f10-4ade-924b-8bca28ce7de1 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:29.866755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 593/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Tue May 10 18:46:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:32.048751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c19a7e-55cb-4b84-9d67-7fcc99123a09 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:32.049764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c19a7e-55cb-4b84-9d67-7fcc99123a09 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:32.049764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c19a7e-55cb-4b84-9d67-7fcc99123a09 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:32.051935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 574/1167] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:32.058509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2362-3700-41e2-a6f0-fb59668946b7 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:32.059275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2362-3700-41e2-a6f0-fb59668946b7 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:32.059420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2362-3700-41e2-a6f0-fb59668946b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:32.081173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-f90b2362-3700-41e2-a6f0-fb59668946b7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:32.082372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f90b2362-3700-41e2-a6f0-fb59668946b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:32.149969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 594/1168] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:32.173052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c19a7e-55cb-4b84-9d67-7fcc99123a09 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:32.284694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c19a7e-55cb-4b84-9d67-7fcc99123a09 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:32.318292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508719a-76f4-409f-9da0-7e4e42c02b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:32.318875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508719a-76f4-409f-9da0-7e4e42c02b35 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:32.319154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508719a-76f4-409f-9da0-7e4e42c02b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:32.319425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508719a-76f4-409f-9da0-7e4e42c02b35 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:32.320161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508719a-76f4-409f-9da0-7e4e42c02b35 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:32.321596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508719a-76f4-409f-9da0-7e4e42c02b35 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:32.339449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 575/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Tue May 10 18:46:32 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:46:34.605860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916fa0c-6d74-4839-bcd3-eeeabd99f7b1 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:34.606735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916fa0c-6d74-4839-bcd3-eeeabd99f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:34.606735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916fa0c-6d74-4839-bcd3-eeeabd99f7b1 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:34.609023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 595/1170] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:34.614606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644e89-42f9-4473-8ce2-948952652979 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:34.615041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644e89-42f9-4473-8ce2-948952652979 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:34.615139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644e89-42f9-4473-8ce2-948952652979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:34.633994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-22644e89-42f9-4473-8ce2-948952652979 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:34.635174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-22644e89-42f9-4473-8ce2-948952652979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:34.705921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 576/1171] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:34.730612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916fa0c-6d74-4839-bcd3-eeeabd99f7b1 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:34.833417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916fa0c-6d74-4839-bcd3-eeeabd99f7b1 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:34.867344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dfb42-4d10-42ca-972e-ecb4fb9ff0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:34.868219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dfb42-4d10-42ca-972e-ecb4fb9ff0a2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:34.868497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dfb42-4d10-42ca-972e-ecb4fb9ff0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:34.868775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dfb42-4d10-42ca-972e-ecb4fb9ff0a2 None admin] PATH_INFO: `/v3/domains/cef66d5588584818bc17e0591a0d507a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:34.879521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dfb42-4d10-42ca-972e-ecb4fb9ff0a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cef66d5588584818bc17e0591a0d507a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:34.881021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dfb42-4d10-42ca-972e-ecb4fb9ff0a2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:34.882602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 596/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Tue May 10 18:46:34 2022] GET /identity/v3/domains/cef66d5588584818bc17e0591a0d507a => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:34.889272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22644e89-42f9-4473-8ce2-948952652979 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:34.993454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22644e89-42f9-4473-8ce2-948952652979 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:35.036588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2406066-70af-4aa1-ad1a-8e4232eb00f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:35.037287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2406066-70af-4aa1-ad1a-8e4232eb00f9 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:35.037573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2406066-70af-4aa1-ad1a-8e4232eb00f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:35.037848 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2406066-70af-4aa1-ad1a-8e4232eb00f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:35.038568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2406066-70af-4aa1-ad1a-8e4232eb00f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:35.040081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2406066-70af-4aa1-ad1a-8e4232eb00f9 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:35.070308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 577/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:46:34 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:46:37.311510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19b099-3da9-4f84-9735-e91b6313d23c None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:37.312402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19b099-3da9-4f84-9735-e91b6313d23c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:37.312402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19b099-3da9-4f84-9735-e91b6313d23c None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:37.313442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 597/1174] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:37.319932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63d0b-a16e-49e5-8b0d-4a99fcdea02c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:37.320731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63d0b-a16e-49e5-8b0d-4a99fcdea02c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:37.320897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63d0b-a16e-49e5-8b0d-4a99fcdea02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:37.340861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-64f63d0b-a16e-49e5-8b0d-4a99fcdea02c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:37.341628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-64f63d0b-a16e-49e5-8b0d-4a99fcdea02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:37.410166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 578/1175] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:37.441702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19b099-3da9-4f84-9735-e91b6313d23c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:37.550004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19b099-3da9-4f84-9735-e91b6313d23c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:37.583578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e9cd7-8fd9-498e-b8da-d5f60d3ccfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:37.584365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9cd7-8fd9-498e-b8da-d5f60d3ccfde None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:37.584640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9cd7-8fd9-498e-b8da-d5f60d3ccfde None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:37.584947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9cd7-8fd9-498e-b8da-d5f60d3ccfde None admin] PATH_INFO: `/v3/domains/cef66d5588584818bc17e0591a0d507a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:37.586189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e9cd7-8fd9-498e-b8da-d5f60d3ccfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=cef66d5588584818bc17e0591a0d507a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:37.587678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e9cd7-8fd9-498e-b8da-d5f60d3ccfde None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:37.589317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 598/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Tue May 10 18:46:37 2022] GET /identity/v3/domains/cef66d5588584818bc17e0591a0d507a => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:37.595364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63d0b-a16e-49e5-8b0d-4a99fcdea02c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:37.697242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63d0b-a16e-49e5-8b0d-4a99fcdea02c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:37.744576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519c6b2-58da-4cd8-9ee3-ef432dfda825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:37.745282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c6b2-58da-4cd8-9ee3-ef432dfda825 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:37.745560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c6b2-58da-4cd8-9ee3-ef432dfda825 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:37.745832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c6b2-58da-4cd8-9ee3-ef432dfda825 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:37.746545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519c6b2-58da-4cd8-9ee3-ef432dfda825 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:37.748000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519c6b2-58da-4cd8-9ee3-ef432dfda825 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:37.772123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 579/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:46:37 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:46:40.019787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0370c3-1f25-45eb-97a9-d13800a00596 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:40.020378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0370c3-1f25-45eb-97a9-d13800a00596 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:40.020378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0370c3-1f25-45eb-97a9-d13800a00596 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:40.021751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 599/1178] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:40.028144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6359b-e015-4abb-a37e-c6aeaf026862 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:40.028880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6359b-e015-4abb-a37e-c6aeaf026862 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:40.029036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6359b-e015-4abb-a37e-c6aeaf026862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:40.056520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-33d6359b-e015-4abb-a37e-c6aeaf026862 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:40.058378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-33d6359b-e015-4abb-a37e-c6aeaf026862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:40.137842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 580/1179] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:40.161900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0370c3-1f25-45eb-97a9-d13800a00596 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:40.268783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0370c3-1f25-45eb-97a9-d13800a00596 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:40.305575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:40.306296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:40.306575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:40.306845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:40.316787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:46:40.324264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:46:40.325432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:46:40.326480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 600/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:46:40.332206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6359b-e015-4abb-a37e-c6aeaf026862 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:40.440900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6359b-e015-4abb-a37e-c6aeaf026862 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:40.478391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:40.479055 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:40.479333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:40.479602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:40.480359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:40.480660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:40.482047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:40.490279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 581/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:46:40.496372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:40.594706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137f6b9-47f1-4773-9918-3178b87de079 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:40.627974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:40.628859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:40.629144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:40.629420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] PATH_INFO: `/v3/users/f9d818ca2c084716a08ccee5c90e4dad` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:40.643102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] RBAC: Authorizing `identity:get_user(user_id=f9d818ca2c084716a08ccee5c90e4dad)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:40.644536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:40.646183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 601/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:40 2022] GET /identity/v3/users/f9d818ca2c084716a08ccee5c90e4dad => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:40.652118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:40.760724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280b0bb-6e09-4e58-ad17-32769b854932 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:40.794075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:40.794711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:40.794987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:40.795253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:40.860004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:40.861456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:40.960045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 582/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:46:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:46:40.966213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:41.078598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e66d-a71e-4916-8694-bf5431cb2650 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:41.113293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3d99c-4426-41e6-9aa1-1bb8bc85a072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:41.114081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d99c-4426-41e6-9aa1-1bb8bc85a072 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:41.114362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d99c-4426-41e6-9aa1-1bb8bc85a072 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:41.114636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d99c-4426-41e6-9aa1-1bb8bc85a072 None admin] PATH_INFO: `/v3/projects/66d5648bf89549ddad5ad4b94ceabd04` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:41.115966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d99c-4426-41e6-9aa1-1bb8bc85a072 None admin] RBAC: Authorizing `identity:get_project(project_id=66d5648bf89549ddad5ad4b94ceabd04)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:41.117444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d99c-4426-41e6-9aa1-1bb8bc85a072 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:41.119621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 602/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:40 2022] GET /identity/v3/projects/66d5648bf89549ddad5ad4b94ceabd04 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:41.126085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:41.226206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbdbeb-62e2-4349-981a-425482b304d2 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:41.260968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab333bf-121a-4a71-a0e6-2b7ffd8c0af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:41.261622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab333bf-121a-4a71-a0e6-2b7ffd8c0af6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:41.261953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab333bf-121a-4a71-a0e6-2b7ffd8c0af6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:41.262283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab333bf-121a-4a71-a0e6-2b7ffd8c0af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:41.263168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab333bf-121a-4a71-a0e6-2b7ffd8c0af6 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=66d5648bf89549ddad5ad4b94ceabd04, user.id=f9d818ca2c084716a08ccee5c90e4dad) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:41.263484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab333bf-121a-4a71-a0e6-2b7ffd8c0af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:41.265148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab333bf-121a-4a71-a0e6-2b7ffd8c0af6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:41.271326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 583/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:46:41 2022] GET /identity/v3/role_assignments?user.id=f9d818ca2c084716a08ccee5c90e4dad&scope.project.id=66d5648bf89549ddad5ad4b94ceabd04&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:43.449566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671ec2-9d88-4b50-b928-8ea1bc1123d7 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:43.450401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671ec2-9d88-4b50-b928-8ea1bc1123d7 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:43.450401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671ec2-9d88-4b50-b928-8ea1bc1123d7 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:43.452384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 603/1186] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:43.460495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3f02-b271-4064-83a9-cdb3bcb942c3 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:43.461223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3f02-b271-4064-83a9-cdb3bcb942c3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:43.461543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3f02-b271-4064-83a9-cdb3bcb942c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:43.479757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-0eba3f02-b271-4064-83a9-cdb3bcb942c3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:43.481008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0eba3f02-b271-4064-83a9-cdb3bcb942c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:43.550939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 584/1187] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:43.574702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671ec2-9d88-4b50-b928-8ea1bc1123d7 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:43.687147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671ec2-9d88-4b50-b928-8ea1bc1123d7 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:43.722638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:43.723358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:43.723639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:43.723912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:43.735507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:46:43.743091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:46:43.744155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:46:43.745178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 604/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:46:43.750390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3f02-b271-4064-83a9-cdb3bcb942c3 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:43.855929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3f02-b271-4064-83a9-cdb3bcb942c3 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:43.890188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:43.890851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:43.891135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:43.891407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:43.892159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:43.892457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:43.893901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:43.902036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 585/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:43.908777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:44.012766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9893b8-49c9-42f9-8cce-bd6865cb503e None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:44.045725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:44.046576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:44.046857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:44.047131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] PATH_INFO: `/v3/users/f9d818ca2c084716a08ccee5c90e4dad` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:44.048363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f9d818ca2c084716a08ccee5c90e4dad)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:44.049850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:44.051426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 605/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:43 2022] GET /identity/v3/users/f9d818ca2c084716a08ccee5c90e4dad => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:44.060355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:44.164574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375997e0-2378-4b0b-bce9-87ff13120c13 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:44.198316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6c66c-5817-4b30-9f81-47b72151dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:44.199178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c66c-5817-4b30-9f81-47b72151dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:44.199463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c66c-5817-4b30-9f81-47b72151dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:44.199733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c66c-5817-4b30-9f81-47b72151dfb6 None admin] PATH_INFO: `/v3/projects/66d5648bf89549ddad5ad4b94ceabd04` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:44.200969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6c66c-5817-4b30-9f81-47b72151dfb6 None admin] RBAC: Authorizing `identity:get_project(project_id=66d5648bf89549ddad5ad4b94ceabd04)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:44.202403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6c66c-5817-4b30-9f81-47b72151dfb6 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:44.204112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 586/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:44 2022] GET /identity/v3/projects/66d5648bf89549ddad5ad4b94ceabd04 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:44.210792 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:44.312483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f600bbe-25c2-4245-abfa-80e4919a20e8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:44.346396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d410-22eb-493a-acfb-83ddb36dddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:44.347014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d410-22eb-493a-acfb-83ddb36dddee None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:44.347298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d410-22eb-493a-acfb-83ddb36dddee None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:44.347573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d410-22eb-493a-acfb-83ddb36dddee None admin] PATH_INFO: `/v3/projects/66d5648bf89549ddad5ad4b94ceabd04/users/f9d818ca2c084716a08ccee5c90e4dad/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:44.349663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d410-22eb-493a-acfb-83ddb36dddee None admin] RBAC: Authorizing `identity:create_grant(project_id=66d5648bf89549ddad5ad4b94ceabd04, user_id=f9d818ca2c084716a08ccee5c90e4dad, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:44.351086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d410-22eb-493a-acfb-83ddb36dddee None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:44.369542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 606/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:46:44 2022] PUT /identity/v3/projects/66d5648bf89549ddad5ad4b94ceabd04/users/f9d818ca2c084716a08ccee5c90e4dad/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:46:46.535195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d9ce-394d-47cb-9ebd-8acdb6b0b575 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:46.536042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d9ce-394d-47cb-9ebd-8acdb6b0b575 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:46.536042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d9ce-394d-47cb-9ebd-8acdb6b0b575 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:46.538447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 587/1193] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:46:46.546550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33533e7-401e-42c8-9b42-44a913f66cb8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:46.547239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33533e7-401e-42c8-9b42-44a913f66cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:46.547239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33533e7-401e-42c8-9b42-44a913f66cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:46.568993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b33533e7-401e-42c8-9b42-44a913f66cb8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:46:46.570195 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b33533e7-401e-42c8-9b42-44a913f66cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:46:46.641902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 607/1194] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:46:46.665819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d9ce-394d-47cb-9ebd-8acdb6b0b575 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:46.773942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d9ce-394d-47cb-9ebd-8acdb6b0b575 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:46.811373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:46.812233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:46.812509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:46.812804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:46.824635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:46:46.832158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:46:46.833348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:46:46.834602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 588/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:46:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:46:46.839570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33533e7-401e-42c8-9b42-44a913f66cb8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:46.948082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33533e7-401e-42c8-9b42-44a913f66cb8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:46.982095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:46.982750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:46.983033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:46.983305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:46.984060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:46.984369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:46.985759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:46.993746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 608/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:46:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:46.999885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:47.105940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b97ac-6f13-4d63-a343-8627df3e6d02 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:47.152109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:47.153018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:47.153298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:47.153573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] PATH_INFO: `/v3/users/f9d818ca2c084716a08ccee5c90e4dad` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:47.154834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] RBAC: Authorizing `identity:get_user(user_id=f9d818ca2c084716a08ccee5c90e4dad)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:47.156276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:47.157933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 589/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Tue May 10 18:46:46 2022] GET /identity/v3/users/f9d818ca2c084716a08ccee5c90e4dad => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:47.164730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:47.273494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1126f-243e-47f2-becc-0857a9f33d6c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:47.307124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:47.307764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:47.308040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:47.308310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:47.373012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:47.374438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:47.470787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 609/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:46:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:46:47.477148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:47.584021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a698343-4427-4ee6-adae-1eec9187ff1e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:47.620447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4867488-5dcc-4471-b5f2-c8296e3ebce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:47.621336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867488-5dcc-4471-b5f2-c8296e3ebce5 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:47.621619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867488-5dcc-4471-b5f2-c8296e3ebce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:47.621894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867488-5dcc-4471-b5f2-c8296e3ebce5 None admin] PATH_INFO: `/v3/projects/66d5648bf89549ddad5ad4b94ceabd04` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:47.623289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4867488-5dcc-4471-b5f2-c8296e3ebce5 None admin] RBAC: Authorizing `identity:get_project(project_id=66d5648bf89549ddad5ad4b94ceabd04)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:47.624661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4867488-5dcc-4471-b5f2-c8296e3ebce5 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:47.626404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 590/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Tue May 10 18:46:47 2022] GET /identity/v3/projects/66d5648bf89549ddad5ad4b94ceabd04 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:46:47.634153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:46:47.743622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa17bb-73bb-48a6-8939-9ecfc73771ea None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:46:47.777334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b53cc4-47eb-4235-bc2b-94ece1436f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:46:47.777964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53cc4-47eb-4235-bc2b-94ece1436f7b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:46:47.778242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53cc4-47eb-4235-bc2b-94ece1436f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:46:47.778514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53cc4-47eb-4235-bc2b-94ece1436f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:46:47.779337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53cc4-47eb-4235-bc2b-94ece1436f7b None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=66d5648bf89549ddad5ad4b94ceabd04, user.id=f9d818ca2c084716a08ccee5c90e4dad) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:46:47.779650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53cc4-47eb-4235-bc2b-94ece1436f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:46:47.781097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53cc4-47eb-4235-bc2b-94ece1436f7b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:46:47.786833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 610/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:46:47 2022] GET /identity/v3/role_assignments?user.id=f9d818ca2c084716a08ccee5c90e4dad&scope.project.id=66d5648bf89549ddad5ad4b94ceabd04&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:47:48.356142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0d6f-e183-4634-8898-f2171d5253c5 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:48.356787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0d6f-e183-4634-8898-f2171d5253c5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:48.356787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0d6f-e183-4634-8898-f2171d5253c5 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:48.359605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 591/1201] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:47:48.366858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e347b-3ecd-4d61-8968-09e27b632f4a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:48.367378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e347b-3ecd-4d61-8968-09e27b632f4a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:48.367378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e347b-3ecd-4d61-8968-09e27b632f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:48.385845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-fe1e347b-3ecd-4d61-8968-09e27b632f4a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:47:48.387047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fe1e347b-3ecd-4d61-8968-09e27b632f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:47:48.474955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 611/1202] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:47:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:47:48.504751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0d6f-e183-4634-8898-f2171d5253c5 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:48.640692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0d6f-e183-4634-8898-f2171d5253c5 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:48.676512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:48.677348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:48.677630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:48.677902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:48.693102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:48.694673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:47:48.712515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:48.713620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:48.715264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:47:48.715264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:47:48.715264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:48.715264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:47:48.715264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 592/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:48.720801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e347b-3ecd-4d61-8968-09e27b632f4a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:48.830761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e347b-3ecd-4d61-8968-09e27b632f4a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:48.869696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43def889-6e36-4116-a7cd-ceef8102018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:48.870513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def889-6e36-4116-a7cd-ceef8102018a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:48.870795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def889-6e36-4116-a7cd-ceef8102018a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:48.871097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def889-6e36-4116-a7cd-ceef8102018a None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:48.871929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43def889-6e36-4116-a7cd-ceef8102018a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:48.872339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43def889-6e36-4116-a7cd-ceef8102018a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:48.874288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43def889-6e36-4116-a7cd-ceef8102018a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:48.887769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 612/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:47:48.896736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:49.018113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b2f3-fd7f-4e70-9352-8b0770b1a462 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:49.055838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c90e07-e66a-4aa6-9ecb-42d0ac0a6414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:49.056552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90e07-e66a-4aa6-9ecb-42d0ac0a6414 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:49.056866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90e07-e66a-4aa6-9ecb-42d0ac0a6414 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:49.057184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90e07-e66a-4aa6-9ecb-42d0ac0a6414 None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:49.057974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c90e07-e66a-4aa6-9ecb-42d0ac0a6414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:49.059682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c90e07-e66a-4aa6-9ecb-42d0ac0a6414 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:49.082418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 593/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Tue May 10 18:47:48 2022] POST /identity/v3/users => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:47:51.476219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef694-e95e-435b-8314-6b4d167de7cb None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:51.476924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef694-e95e-435b-8314-6b4d167de7cb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:51.476924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef694-e95e-435b-8314-6b4d167de7cb None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:51.478393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 613/1206] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:47:51.484197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51dde-45f2-4f4c-a1bb-d6d63003b9f7 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:51.484650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51dde-45f2-4f4c-a1bb-d6d63003b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:51.484786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51dde-45f2-4f4c-a1bb-d6d63003b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:51.501992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-48a51dde-45f2-4f4c-a1bb-d6d63003b9f7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:47:51.503277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-48a51dde-45f2-4f4c-a1bb-d6d63003b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:47:51.578247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 594/1207] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:47:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:47:51.602472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef694-e95e-435b-8314-6b4d167de7cb None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:51.718226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef694-e95e-435b-8314-6b4d167de7cb None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:51.754919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:51.756373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:51.756721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:51.757093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:51.767863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:47:51.777799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:51.779037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:51.779904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 614/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:47:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:51.785355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51dde-45f2-4f4c-a1bb-d6d63003b9f7 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:51.889275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51dde-45f2-4f4c-a1bb-d6d63003b9f7 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:51.929224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:51.929969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:51.930308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:51.930634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:51.931500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:51.931864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:51.933415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:51.944877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 595/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:47:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:47:51.948900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:52.056537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc80d9c-e681-493f-9487-bc0f158db25d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:52.095754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:52.096625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:52.096896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:52.097144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:52.108778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:52.110483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:47:52.129422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:52.130805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:52.131933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:47:52.131933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:47:52.131933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:52.131933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:52.131933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 615/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:52.137574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:52.250315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27259-31d4-45b6-8b15-b1b149665206 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:52.291768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:52.292910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:52.293170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:52.293470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:52.294284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:52.294599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:52.296290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:52.312432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 596/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:47:52.318352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:52.436124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c0077-85eb-460f-9dfb-8b9ec8e50594 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:52.475223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:52.476120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:52.476400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:52.477030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:52.485790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:52.487330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:47:52.505723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:52.508000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 18:47:52.509198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:52.512438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 616/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:47:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:52.513448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:52.627277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4d7c-7ca9-461a-a8ae-821291de09cf None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:52.663354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:52.664200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:52.664541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:52.664916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:52.665762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:52.666068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:52.667493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:52.691624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 597/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Tue May 10 18:47:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:47:52.693184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:52.800134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8d949-bc3d-41eb-b42e-f690db7780aa None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:52.835230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:52.835891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:52.836217 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:52.836492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:52.911325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:52.911941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:53.029680 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 617/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:47:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:47:53.031559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:53.144952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8319e2-3ad0-410a-b065-e7f38d39649f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:53.189326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:53.190214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:53.190529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:53.190765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:53.203659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:53.205398 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:47:53.227761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:53.228959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:53.235849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:47:53.235849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:47:53.235849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:53.235849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:47:53.235849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 598/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:53.236208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:53.353298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71e97c-8504-4d2c-91ad-4c3db72a6bc4 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:53.392853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:53.393707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:53.394091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:53.394468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:53.395309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:53.395663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:53.397345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:53.414204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 618/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:47:53.415597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:53.528290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239408f-6f21-4138-b1c5-7507d31493e1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:53.562679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:53.564562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:53.564562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:53.564562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:53.571455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:53.573003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:47:53.588201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:53.589557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:47:53.593865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 599/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:53.595859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:53.717422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89e20f-67ba-46e9-a7ce-8014fd159027 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:53.757296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1ce8e-b2aa-4640-92ad-97a66c4b83e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:53.758278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1ce8e-b2aa-4640-92ad-97a66c4b83e7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:53.758781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1ce8e-b2aa-4640-92ad-97a66c4b83e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:53.759223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1ce8e-b2aa-4640-92ad-97a66c4b83e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:53.760329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1ce8e-b2aa-4640-92ad-97a66c4b83e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:53.760835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1ce8e-b2aa-4640-92ad-97a66c4b83e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:53.762563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1ce8e-b2aa-4640-92ad-97a66c4b83e7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:53.777159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 619/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:47:53.785992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:53.895507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeddb2-8b0f-4361-95ac-78928f9a5e07 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:53.936741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c8cc-8f18-41d0-bece-8dce52409214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:53.937547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c8cc-8f18-41d0-bece-8dce52409214 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:53.937891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c8cc-8f18-41d0-bece-8dce52409214 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:53.938226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c8cc-8f18-41d0-bece-8dce52409214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:53.939080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c8cc-8f18-41d0-bece-8dce52409214 None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=698df68d01c641c1b4455509d798d2e7) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:53.939398 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c8cc-8f18-41d0-bece-8dce52409214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:53.940865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6c8cc-8f18-41d0-bece-8dce52409214 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:53.956702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 600/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:47:53 2022] GET /identity/v3/role_assignments?user.id=698df68d01c641c1b4455509d798d2e7&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:47:56.464533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b3e3-3536-4cdd-b7e5-eea615544233 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:56.465082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b3e3-3536-4cdd-b7e5-eea615544233 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:56.465179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b3e3-3536-4cdd-b7e5-eea615544233 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:56.466514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 620/1220] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:47:56.472296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c2b17-6cf7-4968-865e-960d07f1606e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:56.472790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c2b17-6cf7-4968-865e-960d07f1606e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:56.472902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c2b17-6cf7-4968-865e-960d07f1606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:56.490676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-260c2b17-6cf7-4968-865e-960d07f1606e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:47:56.491869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-260c2b17-6cf7-4968-865e-960d07f1606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:47:56.563877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 601/1221] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:47:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:47:56.588492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b3e3-3536-4cdd-b7e5-eea615544233 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:56.708432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b3e3-3536-4cdd-b7e5-eea615544233 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:56.748644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:56.749488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:56.749769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:56.750041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:56.760208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:47:56.767752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:56.768772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:56.769636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 621/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:47:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:56.775302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c2b17-6cf7-4968-865e-960d07f1606e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:56.877230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c2b17-6cf7-4968-865e-960d07f1606e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:56.914165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:56.914872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:56.915155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:56.915432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:56.916195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] RBAC: Adding query filter params (name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:56.916503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:56.918113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:56.928722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 602/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:47:56.932967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:57.038906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e563ac4-fcc7-44de-b557-b31df511aabc None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:57.073109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:57.073916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:57.074193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:57.074461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:57.085123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:57.086649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:47:57.103050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:57.104300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:57.105474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:47:57.105474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:47:57.105474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:57.105474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:57.105474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 622/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:57.110094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:57.208403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3eaac-09a3-46b3-9271-84015c0d7199 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:57.243130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:57.243795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:57.244085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:57.244355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:57.245193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:57.245497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:57.246879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:57.259585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 603/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:47:57.266856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:57.374124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5dd3-af12-48f3-8e2e-a0fc1f36a594 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:57.409053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:57.409863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:57.410144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:57.410418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:57.417994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:57.419479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:47:57.434844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:57.436756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:57.438097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 623/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:47:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:57.442131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:57.542200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba445a8-eff3-44d0-9db9-50b8aebbaa8c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:57.576342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:57.577115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:57.577434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:57.577753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:57.578554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:57.578858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:57.580286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:57.602169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 604/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Tue May 10 18:47:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:47:57.603480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:57.712620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1359ba-cde7-4657-aef7-bddc38c3e1e7 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:57.748315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:57.749152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:57.749436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:57.749706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:57.761447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:57.763174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:47:57.783446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:57.784585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:57.785868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:47:57.785868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:47:57.785868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:47:57.785868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:57.785868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 624/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:57.791142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:57.905505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab60be-c8bc-4331-9303-d2b8d394ccee None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:57.943315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:57.945232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:57.945232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:57.945232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:57.945477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:57.945681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:57.947022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:57.960624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 605/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:47:57.966633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:58.078053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58fc5-8bae-4e5e-9209-99048f814c69 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:58.115194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:58.116191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:58.116491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:58.116911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:58.124526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:58.126256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:47:58.143248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:47:58.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:47:58.145369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 625/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:47:58.151493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:58.256548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a272f-2d74-4221-b9ab-18f5bb3e6000 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:58.288522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcdc6b-3ae7-4350-97f6-48fe02888857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:58.289250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc6b-3ae7-4350-97f6-48fe02888857 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:58.289526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc6b-3ae7-4350-97f6-48fe02888857 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:58.289834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc6b-3ae7-4350-97f6-48fe02888857 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:58.290626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc6b-3ae7-4350-97f6-48fe02888857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:47:58.290932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc6b-3ae7-4350-97f6-48fe02888857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:58.292372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc6b-3ae7-4350-97f6-48fe02888857 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:58.304846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 606/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:47:58.314352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:47:58.418950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd60c-77c7-4843-86aa-91e9c0dc5be9 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:47:58.454661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc4b8f-436f-4542-9240-c26f2954334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:47:58.455613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4b8f-436f-4542-9240-c26f2954334c None admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:47:58.455898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4b8f-436f-4542-9240-c26f2954334c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:47:58.456176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4b8f-436f-4542-9240-c26f2954334c None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/698df68d01c641c1b4455509d798d2e7/roles/2ce8fc0880a947b3933dc0c970afe142` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:47:58.472569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc4b8f-436f-4542-9240-c26f2954334c None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=698df68d01c641c1b4455509d798d2e7, role_id=2ce8fc0880a947b3933dc0c970afe142)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:47:58.474083 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc4b8f-436f-4542-9240-c26f2954334c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:47:58.486080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 626/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:47:58 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/698df68d01c641c1b4455509d798d2e7/roles/2ce8fc0880a947b3933dc0c970afe142 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:48:00.735657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9401-45b2-4fd6-aa47-8f27d30abfc3 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:00.736178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9401-45b2-4fd6-aa47-8f27d30abfc3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:00.736178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9401-45b2-4fd6-aa47-8f27d30abfc3 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:00.737527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 607/1233] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:00.743227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b60e2-3fb0-4ecd-8d4c-c15ce638edb1 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:00.743629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b60e2-3fb0-4ecd-8d4c-c15ce638edb1 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:00.743756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b60e2-3fb0-4ecd-8d4c-c15ce638edb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:00.761065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a80b60e2-3fb0-4ecd-8d4c-c15ce638edb1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:00.762457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a80b60e2-3fb0-4ecd-8d4c-c15ce638edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:00.831077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 627/1234] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:48:00.855916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9401-45b2-4fd6-aa47-8f27d30abfc3 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:00.966485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9401-45b2-4fd6-aa47-8f27d30abfc3 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:01.000713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:01.001526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:01.001878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:01.002152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:01.013350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:48:01.021354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:01.022527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:01.023931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 608/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Tue May 10 18:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:01.029031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b60e2-3fb0-4ecd-8d4c-c15ce638edb1 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:01.125599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b60e2-3fb0-4ecd-8d4c-c15ce638edb1 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:01.159556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:01.160248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:01.160525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:01.160834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:01.161590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:01.161894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:01.163265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:01.171868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 628/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Tue May 10 18:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:01.177733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:01.282133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9f52-09dd-429e-a820-5094c4a1a40f None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:01.315641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:01.316487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:01.316796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:01.317073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:01.328037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:01.329580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:01.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:01.349124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:01.350069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:01.350069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:01.350069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:01.350069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:01.350069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 609/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:01.355383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:01.464918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd0a2-8ecd-4632-9020-0c7f4db239c8 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:01.500625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:01.501408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:01.502049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:01.502344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:01.503116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:01.503488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:01.505450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:01.519964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 629/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:01.526259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:01.623480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f027a5-738c-48e2-938c-67dbfb6a3a5b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:01.657888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:01.658715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:01.658993 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:01.659283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] PATH_INFO: `/v3/users/placement` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:01.667848 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:01.669329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:48:01.683855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:01.685212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:01.686376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 610/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:48:01.691303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:01.795914 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c038b-c7e2-4f41-b12c-c82cd6215a5a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:01.832240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:01.832938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:01.833225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:01.833550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:01.834426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:01.834846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:01.836450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:01.856890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 630/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Tue May 10 18:48:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:01.863236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:01.973028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918765-7826-436e-852d-fd0d36cfcdea None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:02.006381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:02.007045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:02.007410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:02.007794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:02.077192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:02.078667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:02.198221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 611/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:48:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:48:02.204547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:02.314803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e28d7c-68cd-4eca-bb43-850a93943962 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:02.351259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:02.352137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:02.352420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:02.352718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:02.363189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:02.364651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:02.384482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:02.385617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:02.386836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:02.386836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:02.386836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:02.386836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:02.386836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 631/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:02.392190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:02.505403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4591d-183b-4c09-a27f-86830d568f08 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:02.539671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:02.540388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:02.540604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:02.540920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:02.541643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:02.541939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:02.543316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:02.554808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 612/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:02.560647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:02.663036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990256f-1daf-4c58-b4ac-7e83c4516b5b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:02.695555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:02.696361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:02.696630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:02.696920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:02.703562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:02.705032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:48:02.718201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:02.719132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:02.720713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 632/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:02.725462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:02.825293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371478eb-b78f-4cb0-be34-6608296305a0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:02.860158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc0844-08b3-44fd-8d09-4bb889490019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:02.861252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc0844-08b3-44fd-8d09-4bb889490019 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:02.861583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc0844-08b3-44fd-8d09-4bb889490019 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:02.861861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc0844-08b3-44fd-8d09-4bb889490019 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:02.862895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc0844-08b3-44fd-8d09-4bb889490019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:02.863242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc0844-08b3-44fd-8d09-4bb889490019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:02.865840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc0844-08b3-44fd-8d09-4bb889490019 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:02.883158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 613/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:02.890068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:03.007831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b1341-e3a7-4612-97ed-beb9cb16b1eb None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:03.043554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07326a3c-1028-4800-8a3c-5f70fbf487ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:03.044238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326a3c-1028-4800-8a3c-5f70fbf487ff None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:03.044516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326a3c-1028-4800-8a3c-5f70fbf487ff None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:03.044821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326a3c-1028-4800-8a3c-5f70fbf487ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:03.045653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326a3c-1028-4800-8a3c-5f70fbf487ff None admin] RBAC: Adding query filter params (role.id=2ce8fc0880a947b3933dc0c970afe142, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=698df68d01c641c1b4455509d798d2e7) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:03.045963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326a3c-1028-4800-8a3c-5f70fbf487ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:03.047384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326a3c-1028-4800-8a3c-5f70fbf487ff None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:03.053477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 633/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:48:02 2022] GET /identity/v3/role_assignments?user.id=698df68d01c641c1b4455509d798d2e7&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=2ce8fc0880a947b3933dc0c970afe142 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:05.656563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b3f0-064c-43ce-9eae-11f4784fc164 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:05.657215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b3f0-064c-43ce-9eae-11f4784fc164 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:05.657215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b3f0-064c-43ce-9eae-11f4784fc164 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:05.658548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 614/1247] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:05.664913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e73cb-94c6-4d4e-810c-530d567bebec None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:05.665379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e73cb-94c6-4d4e-810c-530d567bebec None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:05.665500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e73cb-94c6-4d4e-810c-530d567bebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:05.683600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-754e73cb-94c6-4d4e-810c-530d567bebec None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:05.684835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-754e73cb-94c6-4d4e-810c-530d567bebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:05.761663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 634/1248] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:48:05.785496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b3f0-064c-43ce-9eae-11f4784fc164 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:05.898421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b3f0-064c-43ce-9eae-11f4784fc164 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:05.941536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:05.942552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:05.942910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:05.943372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:05.957690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:48:05.965483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:05.966565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:05.967466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 615/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:48:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:05.973244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e73cb-94c6-4d4e-810c-530d567bebec None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:06.079528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e73cb-94c6-4d4e-810c-530d567bebec None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:06.119015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:06.119780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:06.119966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:06.120317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:06.121032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:06.121355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:06.122772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:06.133002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 635/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:48:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:48:06.139071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:06.252819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfbb9c-e4bc-4913-8ca0-e57130b61ae1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:06.292345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:06.293191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:06.293475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:06.293749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:06.305876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:06.307914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:06.326964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:06.328417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:06.329785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:06.329785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:06.329785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:06.329785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:06.329785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 616/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:06.334296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:06.442066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52f7a1-0260-403e-b4aa-104d9b28c850 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:06.478717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:06.479430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:06.479710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:06.480276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:06.481246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:06.481630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:06.483385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:06.497710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 636/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:06.503292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:06.611490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4932d4-a077-41e0-97e3-95f33c923c5c None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:06.658031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:06.658856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:06.659167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:06.659440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:06.667920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:06.669718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:48:06.684613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:06.685794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:06.686949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 617/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:06.692043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:06.799632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb14a1-28fe-419f-b194-a4c3343dfe1d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:06.834332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:06.835113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:06.835460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:06.835762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:06.836618 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:06.836963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:06.838352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:06.856032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 637/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Tue May 10 18:48:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:06.862295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:06.974592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402f56b-067f-41b1-a792-403da4f5d8a0 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:07.012660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:07.013426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:07.013817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:07.014122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:07.085829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:07.087430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:07.197419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 618/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:48:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 18:48:07.203241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:07.321008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725416c-3bf6-4770-a425-0f0c64e16d5a None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:07.357331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:07.358124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:07.358405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:07.358678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:07.368940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:07.370373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:07.388119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:07.389326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:07.390429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:07.390429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:07.390429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:07.390429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:07.390429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 638/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:07.395515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:07.507432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c3899-dff5-4645-898f-ab88da007983 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:07.547646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:07.548516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:07.548887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:07.549164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:07.550164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:07.550520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:07.552184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:07.565819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 619/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:48:07.572102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:07.678802 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200934d-b747-4d16-ac31-e4467dbf51ba None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:07.715145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:07.716062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:07.716471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:07.716766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:07.724149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:07.726025 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:48:07.742688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:07.743973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:07.745287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 639/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:07.750353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:07.857516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8a61a-0945-4b2f-92b0-b2e67d0c41a1 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:07.898344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b939c1-81e9-4f5f-8bfe-5908dadb1469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:07.899009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b939c1-81e9-4f5f-8bfe-5908dadb1469 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:07.899322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b939c1-81e9-4f5f-8bfe-5908dadb1469 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:07.899593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b939c1-81e9-4f5f-8bfe-5908dadb1469 None admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:07.900518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b939c1-81e9-4f5f-8bfe-5908dadb1469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:07.900853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b939c1-81e9-4f5f-8bfe-5908dadb1469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:07.902299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b939c1-81e9-4f5f-8bfe-5908dadb1469 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:07.915068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 620/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:48:07.925899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:08.043286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274416-5eb2-415b-8676-7aaccfc34699 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:08.080451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c58fd-5670-49d8-80e0-83405ab21864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:08.081148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c58fd-5670-49d8-80e0-83405ab21864 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:08.081429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c58fd-5670-49d8-80e0-83405ab21864 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:08.081699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c58fd-5670-49d8-80e0-83405ab21864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:08.082557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c58fd-5670-49d8-80e0-83405ab21864 None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=698df68d01c641c1b4455509d798d2e7) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:08.082868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c58fd-5670-49d8-80e0-83405ab21864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:08.084339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c58fd-5670-49d8-80e0-83405ab21864 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:08.090633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 640/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:48:07 2022] GET /identity/v3/role_assignments?user.id=698df68d01c641c1b4455509d798d2e7&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=4222709f8e2845f1943f943370bcd122 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:10.318274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7ed4e-a7a6-4095-ab3d-7055c31b34b0 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:10.319172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7ed4e-a7a6-4095-ab3d-7055c31b34b0 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:10.319172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7ed4e-a7a6-4095-ab3d-7055c31b34b0 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:10.321386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 621/1261] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:10.329170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9a76-bd85-4d6c-bfaf-8b071a19fc6d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:10.329586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9a76-bd85-4d6c-bfaf-8b071a19fc6d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:10.329675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9a76-bd85-4d6c-bfaf-8b071a19fc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:10.347161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-effc9a76-bd85-4d6c-bfaf-8b071a19fc6d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:10.348345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-effc9a76-bd85-4d6c-bfaf-8b071a19fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:10.414653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 641/1262] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 18:48:10.437395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7ed4e-a7a6-4095-ab3d-7055c31b34b0 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:10.538467 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7ed4e-a7a6-4095-ab3d-7055c31b34b0 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:10.571588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:10.572288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:10.572562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:10.572841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:10.583239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:48:10.590831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:10.591766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:10.592610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 622/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:10.598125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc9a76-bd85-4d6c-bfaf-8b071a19fc6d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:10.692436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc9a76-bd85-4d6c-bfaf-8b071a19fc6d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:10.723718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:10.724380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:10.724659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:10.724963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:10.725799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:10.726110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:10.727482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:10.735396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 642/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:10.742143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:10.851501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a7b7-ca34-4f84-98b8-2392f343d54a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:10.888822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:10.889728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:10.890052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:10.890334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:10.902963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:10.904793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:10.925020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:10.926286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:10.927439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:10.927439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:10.927439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:10.927439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:10.927439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 623/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:10.933618 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:11.033896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b640b-887d-4fb0-86b8-2ac2a67831a5 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:11.067769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:11.068430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:11.068711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:11.069015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:11.069772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:11.070081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:11.071444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:11.083057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 643/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:11.089848 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:11.207715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a09df-109d-48c5-95b3-263d9d487c56 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:11.241213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:11.242080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:11.242360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:11.242639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:11.251116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:11.253479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:48:11.275830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:11.276957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:11.278121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 624/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:11.283197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:11.383439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80e7fc-8e9b-4d67-897b-9fc304048638 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:11.420030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:11.420722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:11.420997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:11.421273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:11.422122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:11.422427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:11.423860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:11.441099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 644/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Tue May 10 18:48:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:11.447319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:11.563044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034856a-3e11-46e2-8a5a-5e9a3fef219e None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:11.596954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:11.597757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:11.598037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:11.598320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:11.609225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:11.610694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:11.627507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:11.628443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:11.629577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:11.629577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:11.629577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:11.629577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:11.629577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 625/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:11.635923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:11.740394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5123-0e0f-47a3-86e5-b7d85dffa1de None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:11.775700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:11.776347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:11.776631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:11.776910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:11.777649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:11.777957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:11.779317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:11.790396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 645/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:11.796043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:11.930796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3a6a0-ebff-42c4-8004-58beca4eb348 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:11.973479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:11.974635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:11.975003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:11.975359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:11.987015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:11.989379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:48:12.005044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:12.006044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:12.007115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 626/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:12.014525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:12.117416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967485be-bb15-457b-8ecb-6fe2ba1a592c None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:12.151402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a917cc-5669-44dd-af01-e5c59ae6947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:12.152055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a917cc-5669-44dd-af01-e5c59ae6947b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:12.152334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a917cc-5669-44dd-af01-e5c59ae6947b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:12.152606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a917cc-5669-44dd-af01-e5c59ae6947b None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:12.153446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a917cc-5669-44dd-af01-e5c59ae6947b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:12.153751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a917cc-5669-44dd-af01-e5c59ae6947b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:12.155187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a917cc-5669-44dd-af01-e5c59ae6947b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:12.167721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 646/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:12.173794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:12.279709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e26d-8090-4021-9b31-0edac6c00acf None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:12.320578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e5b9-b8b3-4432-a025-9ed70ad50b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:12.321497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e5b9-b8b3-4432-a025-9ed70ad50b29 None admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:12.321783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e5b9-b8b3-4432-a025-9ed70ad50b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:12.322058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e5b9-b8b3-4432-a025-9ed70ad50b29 None admin] PATH_INFO: `/v3/projects/793749d38e914b408bc7d94b6053d624/users/698df68d01c641c1b4455509d798d2e7/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:12.324286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49e5b9-b8b3-4432-a025-9ed70ad50b29 None admin] RBAC: Authorizing `identity:create_grant(project_id=793749d38e914b408bc7d94b6053d624, user_id=698df68d01c641c1b4455509d798d2e7, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:12.325765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49e5b9-b8b3-4432-a025-9ed70ad50b29 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:12.340583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 627/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Tue May 10 18:48:12 2022] PUT /identity/v3/projects/793749d38e914b408bc7d94b6053d624/users/698df68d01c641c1b4455509d798d2e7/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:48:14.519356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c82d8-64d2-4f52-9c7b-8d2686e4ec42 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:14.519878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c82d8-64d2-4f52-9c7b-8d2686e4ec42 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:14.519878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c82d8-64d2-4f52-9c7b-8d2686e4ec42 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:14.521336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 647/1274] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:14.527730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6c19d-02dc-4e58-a307-bc56b1226663 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:14.528466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6c19d-02dc-4e58-a307-bc56b1226663 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:14.528616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6c19d-02dc-4e58-a307-bc56b1226663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:14.550940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-3ba6c19d-02dc-4e58-a307-bc56b1226663 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:14.552142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3ba6c19d-02dc-4e58-a307-bc56b1226663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:14.623107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 628/1275] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:48:14.647677 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c82d8-64d2-4f52-9c7b-8d2686e4ec42 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:14.757441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c82d8-64d2-4f52-9c7b-8d2686e4ec42 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:14.792024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:14.792869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:14.793146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:14.793417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:14.806002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 18:48:14.813546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:14.814493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:14.815321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 648/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Tue May 10 18:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:14.821200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6c19d-02dc-4e58-a307-bc56b1226663 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:14.924686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6c19d-02dc-4e58-a307-bc56b1226663 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:14.958902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:14.959498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:14.959757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:14.960161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:14.960963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:14.961332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:14.962770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:14.971707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 629/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Tue May 10 18:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:14.981033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:15.086916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94232a4-6a1a-4e89-bbbb-35c9c3a0dacf None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:15.119900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:15.120708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:15.120980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:15.121241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:15.133923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:15.135353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:15.151900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:15.152933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:15.153980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:15.153980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:15.153980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:15.153980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:15.153980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 649/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:15.159892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:15.256383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180c5d8-c7d3-49b0-b266-065c1d3d4355 None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:15.289627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:15.290267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:15.290542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:15.290811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:15.291557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:15.291863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:15.293249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:15.304625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 630/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:48:15.310588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:15.410922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e064ccf-4fc6-4bc6-9ba7-063c7bf5bd7d None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:15.443909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:15.444751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:15.445034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:15.445311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:15.453462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:15.455683 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 18:48:15.477869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:15.478895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:15.479855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 650/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:15.485312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:15.582915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d1a28-b337-492a-b0bc-6a7b19dfa80b None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:15.617286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:15.617940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:15.618214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:15.618481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:15.619307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:15.619615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:15.621063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:15.637831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 631/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Tue May 10 18:48:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:15.644109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:15.745921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b5f76-2e14-46d3-8f64-fd1ae91892c2 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:15.779035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:15.779657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:15.779929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:15.780196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:15.844943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:15.846370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:15.959247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 651/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Tue May 10 18:48:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 18:48:15.969028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:16.078775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920136-20c3-49d1-8fb8-22b8116d4f3a None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:16.114000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:16.114793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:16.115072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:16.115345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:16.125509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:16.126952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 18:48:16.144664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:16.145721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:16.146687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 18:48:16.146687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 18:48:16.146687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 18:48:16.146687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:16.146687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 632/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:16.154017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:16.265577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35a86-ff6e-49d8-a25a-dc553b42986f None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:16.299786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:16.300438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:16.300717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:16.301021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:16.301754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:16.302063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:16.303470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:16.314689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 652/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Tue May 10 18:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:16.321462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:16.432663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f5970-9bb9-4c29-9744-2928c752dc3d None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:16.487610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:16.488754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:16.489160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:16.489519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:16.497446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:16.498935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 18:48:16.513117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application with Lock( May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:16.514135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: ERROR keystone.server.flask.application May 10 18:48:16.515095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 633/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Tue May 10 18:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:16.520528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:16.620342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88d2e-924b-4063-ac7e-476eb052ca15 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:16.654231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2254e-e837-4d85-b832-3c68a750b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:16.654844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2254e-e837-4d85-b832-3c68a750b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:16.655154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2254e-e837-4d85-b832-3c68a750b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:16.655428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2254e-e837-4d85-b832-3c68a750b7f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:16.656225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2254e-e837-4d85-b832-3c68a750b7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:16.656537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2254e-e837-4d85-b832-3c68a750b7f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:16.657987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2254e-e837-4d85-b832-3c68a750b7f9 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:16.669769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 653/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Tue May 10 18:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:16.679421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:16.776840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ca3d1-fc55-4d1a-bbcf-86e84fe433ee None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:16.810076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcfaf8-41da-4fb8-b982-ce42697f80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:16.810707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcfaf8-41da-4fb8-b982-ce42697f80fe None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:16.810982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcfaf8-41da-4fb8-b982-ce42697f80fe None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:16.811254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcfaf8-41da-4fb8-b982-ce42697f80fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:16.812077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcfaf8-41da-4fb8-b982-ce42697f80fe None admin] RBAC: Adding query filter params (role.id=4222709f8e2845f1943f943370bcd122, scope.project.id=793749d38e914b408bc7d94b6053d624, user.id=698df68d01c641c1b4455509d798d2e7) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:16.812386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcfaf8-41da-4fb8-b982-ce42697f80fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:16.813835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcfaf8-41da-4fb8-b982-ce42697f80fe None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:16.819578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 634/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Tue May 10 18:48:16 2022] GET /identity/v3/role_assignments?user.id=698df68d01c641c1b4455509d798d2e7&scope.project.id=793749d38e914b408bc7d94b6053d624&role.id=4222709f8e2845f1943f943370bcd122 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:19.067826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402834f-1206-4641-a0c1-ff806f40b625 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:19.068408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402834f-1206-4641-a0c1-ff806f40b625 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:19.068408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402834f-1206-4641-a0c1-ff806f40b625 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:19.070143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 654/1288] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:19.076700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dfc81-415a-4bc0-8790-81d38ab57d56 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:19.077370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dfc81-415a-4bc0-8790-81d38ab57d56 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:19.077370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dfc81-415a-4bc0-8790-81d38ab57d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:19.094786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d25dfc81-415a-4bc0-8790-81d38ab57d56 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:19.095966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d25dfc81-415a-4bc0-8790-81d38ab57d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:19.163477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 635/1289] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:48:19.199940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402834f-1206-4641-a0c1-ff806f40b625 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:19.304388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402834f-1206-4641-a0c1-ff806f40b625 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:19.341810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:19.342547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:19.342828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:19.343105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:19.343764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:19.345182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:19.357198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:19.358389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:19.359273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 655/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:48:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:19.365476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dfc81-415a-4bc0-8790-81d38ab57d56 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:19.476894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dfc81-415a-4bc0-8790-81d38ab57d56 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:19.512034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dff69-4057-47cf-bada-6234919389b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:19.512720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dff69-4057-47cf-bada-6234919389b4 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:19.513022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dff69-4057-47cf-bada-6234919389b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:19.513294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dff69-4057-47cf-bada-6234919389b4 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:19.514020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dff69-4057-47cf-bada-6234919389b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:19.514323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dff69-4057-47cf-bada-6234919389b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:19.515725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dff69-4057-47cf-bada-6234919389b4 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:19.520866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 636/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Tue May 10 18:48:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:19.527231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:19.630390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f71c3-dea7-47dc-84a8-05d77cdad47b None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:19.664343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36309f0-fd1b-4da4-9b51-5d99a7cbd5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:19.665114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36309f0-fd1b-4da4-9b51-5d99a7cbd5ed None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:19.665400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36309f0-fd1b-4da4-9b51-5d99a7cbd5ed None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:19.665683 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36309f0-fd1b-4da4-9b51-5d99a7cbd5ed None admin] PATH_INFO: `/v3/services` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:19.666397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36309f0-fd1b-4da4-9b51-5d99a7cbd5ed None admin] RBAC: Adding query filter params (type=placement) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:19.666710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36309f0-fd1b-4da4-9b51-5d99a7cbd5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:19.668075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36309f0-fd1b-4da4-9b51-5d99a7cbd5ed None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:19.672592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 656/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Tue May 10 18:48:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:21.887512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9cf71-41b4-4a84-bc0f-86dba7055115 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:21.888216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9cf71-41b4-4a84-bc0f-86dba7055115 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:21.888216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9cf71-41b4-4a84-bc0f-86dba7055115 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:21.889492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 637/1293] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:21.895822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2f9c-e07d-4c98-8b9d-1aaef2ab7546 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:21.896756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2f9c-e07d-4c98-8b9d-1aaef2ab7546 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:21.897131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2f9c-e07d-4c98-8b9d-1aaef2ab7546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:21.915563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b2dc2f9c-e07d-4c98-8b9d-1aaef2ab7546 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:21.916911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b2dc2f9c-e07d-4c98-8b9d-1aaef2ab7546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:21.985682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 657/1294] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:48:22.008807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9cf71-41b4-4a84-bc0f-86dba7055115 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:22.110968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9cf71-41b4-4a84-bc0f-86dba7055115 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:22.146443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee1b04-9d7b-4979-95bf-9d13cd264ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:22.147020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee1b04-9d7b-4979-95bf-9d13cd264ac3 None admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:22.147295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee1b04-9d7b-4979-95bf-9d13cd264ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:22.147567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee1b04-9d7b-4979-95bf-9d13cd264ac3 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:22.148293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee1b04-9d7b-4979-95bf-9d13cd264ac3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:22.149725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee1b04-9d7b-4979-95bf-9d13cd264ac3 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:22.165241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 638/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Tue May 10 18:48:22 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:48:24.387745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6aed-8ec1-4b46-8765-21544995e006 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:24.388313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6aed-8ec1-4b46-8765-21544995e006 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:24.388313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6aed-8ec1-4b46-8765-21544995e006 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:24.389744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 658/1296] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:24.396085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ffd3d-dd0d-4616-95b6-b0be13edac8c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:24.396807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ffd3d-dd0d-4616-95b6-b0be13edac8c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:24.397018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ffd3d-dd0d-4616-95b6-b0be13edac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:24.421260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-e17ffd3d-dd0d-4616-95b6-b0be13edac8c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:24.422454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e17ffd3d-dd0d-4616-95b6-b0be13edac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:24.503541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 639/1297] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:48:24.534036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6aed-8ec1-4b46-8765-21544995e006 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:24.641008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6aed-8ec1-4b46-8765-21544995e006 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:24.675179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:24.675972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:24.676256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:24.676531 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] PATH_INFO: `/v3/services/placement` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:24.677223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:24.678603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:24.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:24.691681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:24.692789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 659/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:48:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 18:48:24.698344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ffd3d-dd0d-4616-95b6-b0be13edac8c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:24.799581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ffd3d-dd0d-4616-95b6-b0be13edac8c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:24.837312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:24.837988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:24.838260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:24.838529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:24.839239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] RBAC: Adding query filter params (name=placement) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:24.839544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:24.840936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:24.846414 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 640/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Tue May 10 18:48:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:24.853098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:24.956299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc682b-56cc-4d56-afbe-b72b62e22bbe None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:24.989858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467380a3-7078-49d4-afbc-b1764cbdf74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:24.990513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467380a3-7078-49d4-afbc-b1764cbdf74a None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:24.990797 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467380a3-7078-49d4-afbc-b1764cbdf74a None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:24.991075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467380a3-7078-49d4-afbc-b1764cbdf74a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:24.991874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467380a3-7078-49d4-afbc-b1764cbdf74a None admin] RBAC: Adding query filter params (interface=public, service_id=73400cea18dc4b70bf704b6e9a1ae4f9, region_id=RegionOne) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:24.992190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467380a3-7078-49d4-afbc-b1764cbdf74a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:24.993626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467380a3-7078-49d4-afbc-b1764cbdf74a None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:24.998713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 660/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Tue May 10 18:48:24 2022] GET /identity/v3/endpoints?service_id=73400cea18dc4b70bf704b6e9a1ae4f9&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:48:25.005829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:25.107345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9888-6f94-4225-9aa4-4882a1a4aacb None admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:25.144555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55d71-36b5-485e-9f7f-e869d9c4b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:25.145248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55d71-36b5-485e-9f7f-e869d9c4b899 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:25.145530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55d71-36b5-485e-9f7f-e869d9c4b899 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:25.145805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55d71-36b5-485e-9f7f-e869d9c4b899 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:25.146482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55d71-36b5-485e-9f7f-e869d9c4b899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:25.147847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55d71-36b5-485e-9f7f-e869d9c4b899 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:25.154701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 641/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Tue May 10 18:48:25 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:48:27.330832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62f4f-966c-4301-bcb3-f94c2f25cc10 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:27.331423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62f4f-966c-4301-bcb3-f94c2f25cc10 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:27.331423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62f4f-966c-4301-bcb3-f94c2f25cc10 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:27.332724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 661/1302] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:48:27.339291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ece2-0cab-4090-82c5-0b822cce9460 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:27.340032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ece2-0cab-4090-82c5-0b822cce9460 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:27.340181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ece2-0cab-4090-82c5-0b822cce9460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:27.361530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9ef8ece2-0cab-4090-82c5-0b822cce9460 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:48:27.362715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9ef8ece2-0cab-4090-82c5-0b822cce9460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:48:27.430625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 642/1303] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:48:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 18:48:27.453801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a62f4f-966c-4301-bcb3-f94c2f25cc10 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:27.568263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a62f4f-966c-4301-bcb3-f94c2f25cc10 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:27.605845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:27.606591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:27.606875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:27.607151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:27.607810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:27.609233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 18:48:27.621005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 18:48:27.622227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.get_or_create( May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application with Lock( May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self._enter() May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application return self.creator() May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application created_value = creator( May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: ERROR keystone.server.flask.application May 10 18:48:27.623267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 662/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Tue May 10 18:48:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 18:48:27.628602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ece2-0cab-4090-82c5-0b822cce9460 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:27.728205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ece2-0cab-4090-82c5-0b822cce9460 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:27.776945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b7f75-1ff3-40d8-8d35-d01bb7236cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:27.777636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b7f75-1ff3-40d8-8d35-d01bb7236cb2 None admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:27.777916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b7f75-1ff3-40d8-8d35-d01bb7236cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:27.778189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b7f75-1ff3-40d8-8d35-d01bb7236cb2 None admin] PATH_INFO: `/v3/services` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:27.778901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b7f75-1ff3-40d8-8d35-d01bb7236cb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:48:27.779206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b7f75-1ff3-40d8-8d35-d01bb7236cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:27.780600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b7f75-1ff3-40d8-8d35-d01bb7236cb2 None admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:27.786198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 643/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Tue May 10 18:48:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:48:27.792276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:48:27.895052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c570-5058-4465-9d2c-934a67a776a3 None admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:48:27.929180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e7eb9-3ea5-46b0-a929-836458d309a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:48:27.929875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e7eb9-3ea5-46b0-a929-836458d309a5 None admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:48:27.930158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e7eb9-3ea5-46b0-a929-836458d309a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:48:27.930433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e7eb9-3ea5-46b0-a929-836458d309a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:48:27.931179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e7eb9-3ea5-46b0-a929-836458d309a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:48:27.932576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e7eb9-3ea5-46b0-a929-836458d309a5 None admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:48:27.956135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 663/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Tue May 10 18:48:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:49:31.850579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fce285-6a71-495f-ac2b-fcbf475479db None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:31.851071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fce285-6a71-495f-ac2b-fcbf475479db None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:31.851178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fce285-6a71-495f-ac2b-fcbf475479db None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:31.852807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 644/1307] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:31.858122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb55f16-48ce-4a24-8b43-8a150dd8baa6 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:31.858568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb55f16-48ce-4a24-8b43-8a150dd8baa6 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:31.858652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb55f16-48ce-4a24-8b43-8a150dd8baa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:32.046737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6fb55f16-48ce-4a24-8b43-8a150dd8baa6 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:32.047912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6fb55f16-48ce-4a24-8b43-8a150dd8baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:32.289559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 664/1308] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:32.359481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027269f-bc52-473d-991f-05046bcd2edd None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:32.359748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027269f-bc52-473d-991f-05046bcd2edd None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:32.360029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027269f-bc52-473d-991f-05046bcd2edd None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:32.361457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 645/1309] 10.222.0.52 () {54 vars in 964 bytes} [Tue May 10 18:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:32.367808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6cb62-71cc-4ebf-9313-2d8c5f0a9f15 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:32.368066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6cb62-71cc-4ebf-9313-2d8c5f0a9f15 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:32.368360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6cb62-71cc-4ebf-9313-2d8c5f0a9f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:32.517837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-97f6cb62-71cc-4ebf-9313-2d8c5f0a9f15 None None] MFA Rules not processed for user `945283f83c1b4ee0a1a59b0732090fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:32.519363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-97f6cb62-71cc-4ebf-9313-2d8c5f0a9f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:32.602248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 665/1310] 10.222.0.52 () {58 vars in 1061 bytes} [Tue May 10 18:49:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:32.610876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027269f-bc52-473d-991f-05046bcd2edd None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:32.612982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3027269f-bc52-473d-991f-05046bcd2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:32.728829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027269f-bc52-473d-991f-05046bcd2edd None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:32.805368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ea69-7af6-47c3-8e0e-c45c2f878ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:32.806542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ea69-7af6-47c3-8e0e-c45c2f878ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:32.806999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ea69-7af6-47c3-8e0e-c45c2f878ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:32.808004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ea69-7af6-47c3-8e0e-c45c2f878ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:32.810003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-dc85ea69-7af6-47c3-8e0e-c45c2f878ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:32.934888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85ea69-7af6-47c3-8e0e-c45c2f878ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:32.937354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85ea69-7af6-47c3-8e0e-c45c2f878ec8 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:32.963499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 646/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:35.496420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7d35-4227-4704-8cf5-c87f2029d31f None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:35.496951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7d35-4227-4704-8cf5-c87f2029d31f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:35.496951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7d35-4227-4704-8cf5-c87f2029d31f None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:35.498278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 666/1312] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:35.504337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad535fe-2013-4457-8815-39ee151fb551 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:35.504789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad535fe-2013-4457-8815-39ee151fb551 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:35.504954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad535fe-2013-4457-8815-39ee151fb551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:35.575678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7ad535fe-2013-4457-8815-39ee151fb551 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:35.576950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7ad535fe-2013-4457-8815-39ee151fb551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:35.678661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 647/1313] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:35.716417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc7d35-4227-4704-8cf5-c87f2029d31f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:35.718112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b0dc7d35-4227-4704-8cf5-c87f2029d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:35.821833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc7d35-4227-4704-8cf5-c87f2029d31f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:35.894232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e436b-ae53-4b60-b7ca-6b41b423f3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:35.894882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e436b-ae53-4b60-b7ca-6b41b423f3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:35.895161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e436b-ae53-4b60-b7ca-6b41b423f3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:35.895442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e436b-ae53-4b60-b7ca-6b41b423f3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:35.897234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-349e436b-ae53-4b60-b7ca-6b41b423f3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:36.005512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e436b-ae53-4b60-b7ca-6b41b423f3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:36.006966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e436b-ae53-4b60-b7ca-6b41b423f3c4 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:36.025919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 667/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:38.568646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf42e-8164-4ba2-8a49-477f5867433c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:38.569610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf42e-8164-4ba2-8a49-477f5867433c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:38.569610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf42e-8164-4ba2-8a49-477f5867433c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:38.571826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 648/1315] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:38.577245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fee3-2014-42dd-bc34-7e7558c86d8a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:38.577695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fee3-2014-42dd-bc34-7e7558c86d8a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:38.577799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fee3-2014-42dd-bc34-7e7558c86d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:38.642307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5745fee3-2014-42dd-bc34-7e7558c86d8a None None] MFA Rules not processed for user `0dc039f6005b420e807bfb06c480aa30`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:38.643502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5745fee3-2014-42dd-bc34-7e7558c86d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:38.745480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 668/1316] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:38.794625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bf42e-8164-4ba2-8a49-477f5867433c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:38.796466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-255bf42e-8164-4ba2-8a49-477f5867433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:38.902023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bf42e-8164-4ba2-8a49-477f5867433c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:38.974105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fab8e-c980-495b-8786-64aad7e047e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:38.974747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fab8e-c980-495b-8786-64aad7e047e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:38.975025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fab8e-c980-495b-8786-64aad7e047e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:38.975291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fab8e-c980-495b-8786-64aad7e047e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:38.976959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-967fab8e-c980-495b-8786-64aad7e047e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:39.093765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fab8e-c980-495b-8786-64aad7e047e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:39.095134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fab8e-c980-495b-8786-64aad7e047e0 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:39.114184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 649/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:41.904628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958cbbd-df1f-4966-a51d-4003c751f545 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:41.905257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958cbbd-df1f-4966-a51d-4003c751f545 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:41.905257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958cbbd-df1f-4966-a51d-4003c751f545 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:41.906619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 669/1318] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:41.913732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51c559-0858-4847-9396-dd37a7e46356 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:41.914152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51c559-0858-4847-9396-dd37a7e46356 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:41.914267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51c559-0858-4847-9396-dd37a7e46356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:41.980699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-bf51c559-0858-4847-9396-dd37a7e46356 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:41.981931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-bf51c559-0858-4847-9396-dd37a7e46356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:42.085306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 650/1319] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:49:42.126981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958cbbd-df1f-4966-a51d-4003c751f545 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:42.129470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3958cbbd-df1f-4966-a51d-4003c751f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:42.235506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958cbbd-df1f-4966-a51d-4003c751f545 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:42.311389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3dc32-8bb7-4205-b21d-6bb166dcdeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:42.312143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3dc32-8bb7-4205-b21d-6bb166dcdeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:42.312468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3dc32-8bb7-4205-b21d-6bb166dcdeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:42.312765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3dc32-8bb7-4205-b21d-6bb166dcdeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:42.314472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f4b3dc32-8bb7-4205-b21d-6bb166dcdeb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:42.449045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3dc32-8bb7-4205-b21d-6bb166dcdeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:42.450487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3dc32-8bb7-4205-b21d-6bb166dcdeb4 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:42.474576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 670/1320] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:45.321129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70681c5d-aedc-4d48-9f96-745094c1290b None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:45.321698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70681c5d-aedc-4d48-9f96-745094c1290b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:45.321698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70681c5d-aedc-4d48-9f96-745094c1290b None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:45.323083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 651/1321] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:45.328455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16def4e-5a34-42db-9cde-355161f61b5a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:45.328932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16def4e-5a34-42db-9cde-355161f61b5a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:45.329028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16def4e-5a34-42db-9cde-355161f61b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:45.395629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-d16def4e-5a34-42db-9cde-355161f61b5a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:45.396914 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d16def4e-5a34-42db-9cde-355161f61b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:45.493873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 671/1322] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:45.545409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b25c6-3596-4a50-8653-cc521f97bb59 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:45.545638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b25c6-3596-4a50-8653-cc521f97bb59 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:45.545953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b25c6-3596-4a50-8653-cc521f97bb59 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:45.547353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 652/1323] 10.222.0.52 () {54 vars in 964 bytes} [Tue May 10 18:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:45.553513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3ce0e-bc72-405a-bf9a-cec10f239a97 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:45.553798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3ce0e-bc72-405a-bf9a-cec10f239a97 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:45.554080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3ce0e-bc72-405a-bf9a-cec10f239a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:45.630621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-68f3ce0e-bc72-405a-bf9a-cec10f239a97 None None] MFA Rules not processed for user `945283f83c1b4ee0a1a59b0732090fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:45.631846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-68f3ce0e-bc72-405a-bf9a-cec10f239a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:45.710902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 672/1324] 10.222.0.52 () {58 vars in 1061 bytes} [Tue May 10 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:45.720148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b25c6-3596-4a50-8653-cc521f97bb59 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:45.721783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4f1b25c6-3596-4a50-8653-cc521f97bb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:45.830489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b25c6-3596-4a50-8653-cc521f97bb59 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:45.904817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ceda-4ee6-4441-ba20-3db44a58da4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:45.905408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ceda-4ee6-4441-ba20-3db44a58da4d service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:45.905691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ceda-4ee6-4441-ba20-3db44a58da4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:45.905968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ceda-4ee6-4441-ba20-3db44a58da4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:45.907607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-aaa2ceda-4ee6-4441-ba20-3db44a58da4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:46.016705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2ceda-4ee6-4441-ba20-3db44a58da4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:46.018139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2ceda-4ee6-4441-ba20-3db44a58da4d service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:46.035849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 653/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:48.529383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb140a-001c-4f08-bbcf-9d6707951ebd None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:48.529956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb140a-001c-4f08-bbcf-9d6707951ebd None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:48.529956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb140a-001c-4f08-bbcf-9d6707951ebd None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:48.531300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 673/1326] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:48.536785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d8d3-94f8-456a-9af3-d59b9475d62d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:48.537209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d8d3-94f8-456a-9af3-d59b9475d62d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:48.537316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d8d3-94f8-456a-9af3-d59b9475d62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:48.601311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9ec1d8d3-94f8-456a-9af3-d59b9475d62d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:48.602519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9ec1d8d3-94f8-456a-9af3-d59b9475d62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:48.700366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 654/1327] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:48.735864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb140a-001c-4f08-bbcf-9d6707951ebd None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:48.737443 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2ccb140a-001c-4f08-bbcf-9d6707951ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:48.842216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb140a-001c-4f08-bbcf-9d6707951ebd None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:48.918790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1077a-57db-44b9-a15b-fb226909b037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:48.919459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1077a-57db-44b9-a15b-fb226909b037 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:48.919740 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1077a-57db-44b9-a15b-fb226909b037 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:48.920008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1077a-57db-44b9-a15b-fb226909b037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:48.921736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8bd1077a-57db-44b9-a15b-fb226909b037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:49.033185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1077a-57db-44b9-a15b-fb226909b037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:49.034540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1077a-57db-44b9-a15b-fb226909b037 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:49.052404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 674/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:51.305652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af65a-bb40-44c1-b5da-d22058b6f9c3 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:51.306217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af65a-bb40-44c1-b5da-d22058b6f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:51.306217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af65a-bb40-44c1-b5da-d22058b6f9c3 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:51.307572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 655/1329] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:51.313130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e02b2f-b1d5-4ce7-b394-445a1ac8d656 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:51.313578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e02b2f-b1d5-4ce7-b394-445a1ac8d656 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:51.313869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e02b2f-b1d5-4ce7-b394-445a1ac8d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:51.382801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-01e02b2f-b1d5-4ce7-b394-445a1ac8d656 None None] MFA Rules not processed for user `0dc039f6005b420e807bfb06c480aa30`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:51.384065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-01e02b2f-b1d5-4ce7-b394-445a1ac8d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:51.481365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 675/1330] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:51.519916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7af65a-bb40-44c1-b5da-d22058b6f9c3 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:51.521586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-aa7af65a-bb40-44c1-b5da-d22058b6f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:51.622374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7af65a-bb40-44c1-b5da-d22058b6f9c3 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:51.695155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087062-d852-498a-b04b-c64954f5f75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:51.695804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087062-d852-498a-b04b-c64954f5f75e service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:51.696085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087062-d852-498a-b04b-c64954f5f75e service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:51.696361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087062-d852-498a-b04b-c64954f5f75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:51.698028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-78087062-d852-498a-b04b-c64954f5f75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:51.821227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087062-d852-498a-b04b-c64954f5f75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:51.822683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087062-d852-498a-b04b-c64954f5f75e service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:51.840192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 656/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:54.302661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea72e9-3352-4c5a-b895-2dc87e700853 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:54.303588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea72e9-3352-4c5a-b895-2dc87e700853 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:54.303837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea72e9-3352-4c5a-b895-2dc87e700853 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:54.305552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 676/1332] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:54.311379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312183-8687-41a0-865c-fc85b14c1c20 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:54.312470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312183-8687-41a0-865c-fc85b14c1c20 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:54.313000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312183-8687-41a0-865c-fc85b14c1c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:54.386500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ee312183-8687-41a0-865c-fc85b14c1c20 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:54.387853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ee312183-8687-41a0-865c-fc85b14c1c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:54.488465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 657/1333] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:54.524184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea72e9-3352-4c5a-b895-2dc87e700853 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:54.525833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-81ea72e9-3352-4c5a-b895-2dc87e700853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:54.630978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea72e9-3352-4c5a-b895-2dc87e700853 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:54.703525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11ab3e-8823-4902-aceb-c4e82e41bb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:54.704330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ab3e-8823-4902-aceb-c4e82e41bb34 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:54.704612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ab3e-8823-4902-aceb-c4e82e41bb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:54.704917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ab3e-8823-4902-aceb-c4e82e41bb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:54.706577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-dc11ab3e-8823-4902-aceb-c4e82e41bb34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:54.813857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11ab3e-8823-4902-aceb-c4e82e41bb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:54.815225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11ab3e-8823-4902-aceb-c4e82e41bb34 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:54.833739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 677/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:49:57.099077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381f74-6e10-4b49-ab62-f307b0a78861 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:57.099659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381f74-6e10-4b49-ab62-f307b0a78861 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:57.099659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381f74-6e10-4b49-ab62-f307b0a78861 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:57.101115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 658/1335] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:49:57.107470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced8f1-3253-4c1f-8d5b-8da3e3befeb1 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:57.108192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced8f1-3253-4c1f-8d5b-8da3e3befeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:57.108345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced8f1-3253-4c1f-8d5b-8da3e3befeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:57.182863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e8ced8f1-3253-4c1f-8d5b-8da3e3befeb1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:49:57.184074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e8ced8f1-3253-4c1f-8d5b-8da3e3befeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:57.286731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 678/1336] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:49:57.327551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381f74-6e10-4b49-ab62-f307b0a78861 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:49:57.330002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8c381f74-6e10-4b49-ab62-f307b0a78861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:57.453185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381f74-6e10-4b49-ab62-f307b0a78861 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:49:57.541477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf8faa-8c86-4107-8394-db9cf709c974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:49:57.542463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8faa-8c86-4107-8394-db9cf709c974 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:49:57.542849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8faa-8c86-4107-8394-db9cf709c974 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:49:57.543274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8faa-8c86-4107-8394-db9cf709c974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:49:57.545932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8dcf8faa-8c86-4107-8394-db9cf709c974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:49:57.665033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf8faa-8c86-4107-8394-db9cf709c974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:49:57.666472 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf8faa-8c86-4107-8394-db9cf709c974 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:49:57.685768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 659/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:00.539834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3e16-6aa7-4748-81f8-5f08bd33cbd6 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:00.540437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3e16-6aa7-4748-81f8-5f08bd33cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:00.540437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3e16-6aa7-4748-81f8-5f08bd33cbd6 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:00.541801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 679/1338] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:00.548090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb92b-401b-4684-89c7-337f24c7d8a4 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:00.548859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb92b-401b-4684-89c7-337f24c7d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:00.548994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb92b-401b-4684-89c7-337f24c7d8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:00.616183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1adfb92b-401b-4684-89c7-337f24c7d8a4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:00.617435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1adfb92b-401b-4684-89c7-337f24c7d8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:00.714425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 660/1339] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:00.749688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3e16-6aa7-4748-81f8-5f08bd33cbd6 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:00.751593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4cbb3e16-6aa7-4748-81f8-5f08bd33cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:00.856660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3e16-6aa7-4748-81f8-5f08bd33cbd6 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:00.935108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77421e33-02df-456f-b6f4-84b3a46512e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:00.935780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421e33-02df-456f-b6f4-84b3a46512e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:00.936053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421e33-02df-456f-b6f4-84b3a46512e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:00.936320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421e33-02df-456f-b6f4-84b3a46512e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:00.938000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-77421e33-02df-456f-b6f4-84b3a46512e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:01.050719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77421e33-02df-456f-b6f4-84b3a46512e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:01.052093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77421e33-02df-456f-b6f4-84b3a46512e2 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:01.070435 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 680/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:50:05.450885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821013f6-909c-4215-b139-9739351a1e4d None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:05.451405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821013f6-909c-4215-b139-9739351a1e4d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:05.451573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821013f6-909c-4215-b139-9739351a1e4d None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:05.453280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 661/1341] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:05.458745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e8fe4-aa32-4845-b86b-be46749db3da None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:05.459197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e8fe4-aa32-4845-b86b-be46749db3da None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:05.459304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e8fe4-aa32-4845-b86b-be46749db3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:05.529529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-076e8fe4-aa32-4845-b86b-be46749db3da None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:05.530711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-076e8fe4-aa32-4845-b86b-be46749db3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:05.636976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 681/1342] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:05.675159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821013f6-909c-4215-b139-9739351a1e4d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:05.677670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-821013f6-909c-4215-b139-9739351a1e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:05.774286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821013f6-909c-4215-b139-9739351a1e4d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:05.778229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39563456-6967-45ea-b88a-55020f35ffe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:05.778904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39563456-6967-45ea-b88a-55020f35ffe0 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:05.779193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39563456-6967-45ea-b88a-55020f35ffe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:05.779430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39563456-6967-45ea-b88a-55020f35ffe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:05.788859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39563456-6967-45ea-b88a-55020f35ffe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:05.790325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39563456-6967-45ea-b88a-55020f35ffe0 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:05.799613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 662/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:08.622035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205e2cc-5ef7-47c7-bad9-e40c690374ac None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:08.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205e2cc-5ef7-47c7-bad9-e40c690374ac None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:08.622673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205e2cc-5ef7-47c7-bad9-e40c690374ac None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:08.623969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 682/1344] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:08.629920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f859-781f-425d-aa41-f75e277a7e65 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:08.630411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f859-781f-425d-aa41-f75e277a7e65 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:08.630560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f859-781f-425d-aa41-f75e277a7e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:08.659330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-34d4f859-781f-425d-aa41-f75e277a7e65 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:08.660522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-34d4f859-781f-425d-aa41-f75e277a7e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:08.742046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 663/1345] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:08.779287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205e2cc-5ef7-47c7-bad9-e40c690374ac None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:08.781484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e205e2cc-5ef7-47c7-bad9-e40c690374ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:08.796546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205e2cc-5ef7-47c7-bad9-e40c690374ac None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:08.800052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e550-97e0-475f-8812-7c914c928c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:08.800728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e550-97e0-475f-8812-7c914c928c10 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:08.801015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e550-97e0-475f-8812-7c914c928c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:08.801291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e550-97e0-475f-8812-7c914c928c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:08.810889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e550-97e0-475f-8812-7c914c928c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:08.812326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e550-97e0-475f-8812-7c914c928c10 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:08.822041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 683/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:13.041848 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5c33-48bd-4a1d-a63a-10ae65377a3c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:13.042366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5c33-48bd-4a1d-a63a-10ae65377a3c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:13.042366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5c33-48bd-4a1d-a63a-10ae65377a3c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:13.043689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 664/1347] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:13.049020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675371d-21d0-477d-8f98-5e510a1be33e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:13.049461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675371d-21d0-477d-8f98-5e510a1be33e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:13.049563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675371d-21d0-477d-8f98-5e510a1be33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:13.067941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7675371d-21d0-477d-8f98-5e510a1be33e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:13.069167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7675371d-21d0-477d-8f98-5e510a1be33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:13.077873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 684/1348] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:13.115474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d5c33-48bd-4a1d-a63a-10ae65377a3c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:13.127215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d5c33-48bd-4a1d-a63a-10ae65377a3c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:13.131230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8ad1b-e732-4314-9e86-1d356450902f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:13.131877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ad1b-e732-4314-9e86-1d356450902f service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:13.132151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ad1b-e732-4314-9e86-1d356450902f service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:13.132382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ad1b-e732-4314-9e86-1d356450902f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:13.141877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8ad1b-e732-4314-9e86-1d356450902f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:13.143309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8ad1b-e732-4314-9e86-1d356450902f service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:13.152840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 665/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:18.441941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ecdb0-dad1-48a5-8886-a35bc2c6b30e None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:18.442833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ecdb0-dad1-48a5-8886-a35bc2c6b30e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:18.443285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ecdb0-dad1-48a5-8886-a35bc2c6b30e None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:18.445241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 685/1350] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 18:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:18.450415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d39dc-395b-4db4-bed1-9c63611aff4f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:18.451183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d39dc-395b-4db4-bed1-9c63611aff4f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:18.451617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d39dc-395b-4db4-bed1-9c63611aff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:18.519061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-0e5d39dc-395b-4db4-bed1-9c63611aff4f None None] MFA Rules not processed for user `698df68d01c641c1b4455509d798d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:18.520456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0e5d39dc-395b-4db4-bed1-9c63611aff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:18.610404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 666/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:50:22.887517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011563-f69b-4184-a02d-048895fb5d23 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:22.888159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011563-f69b-4184-a02d-048895fb5d23 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:22.888598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011563-f69b-4184-a02d-048895fb5d23 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:22.890358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 686/1352] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 18:50:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:22.895393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177021f6-35b4-4a3f-be78-02e938508142 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:22.895886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177021f6-35b4-4a3f-be78-02e938508142 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:22.896101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177021f6-35b4-4a3f-be78-02e938508142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:22.915362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-177021f6-35b4-4a3f-be78-02e938508142 None None] MFA Rules not processed for user `698df68d01c641c1b4455509d798d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:22.916609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-177021f6-35b4-4a3f-be78-02e938508142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:22.925970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 667/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 18:50:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:24.176705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a9b9-7884-44c0-8bfc-d3fa13538df7 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:24.177262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a9b9-7884-44c0-8bfc-d3fa13538df7 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:24.177377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a9b9-7884-44c0-8bfc-d3fa13538df7 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:24.178664 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 687/1354] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 18:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:24.183847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21433ae2-ee16-4361-90aa-e03f236e3fd6 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:24.184302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21433ae2-ee16-4361-90aa-e03f236e3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:24.184410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21433ae2-ee16-4361-90aa-e03f236e3fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:24.205748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-21433ae2-ee16-4361-90aa-e03f236e3fd6 None None] MFA Rules not processed for user `698df68d01c641c1b4455509d798d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:24.206997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-21433ae2-ee16-4361-90aa-e03f236e3fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:24.215768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 668/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 18:50:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:28.220397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9726e2-aa29-4a33-b95e-4b1e62b53e55 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:28.220959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9726e2-aa29-4a33-b95e-4b1e62b53e55 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:28.220959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9726e2-aa29-4a33-b95e-4b1e62b53e55 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:28.222828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 688/1356] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:28.227505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468134f-180e-4095-a129-c6131abb7089 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:28.227933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468134f-180e-4095-a129-c6131abb7089 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:28.228113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468134f-180e-4095-a129-c6131abb7089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:28.246194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a468134f-180e-4095-a129-c6131abb7089 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:28.247620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a468134f-180e-4095-a129-c6131abb7089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:28.256476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 669/1357] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:28.303865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2421fe-70fc-4e24-985b-4ad3c6be4c77 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:28.304134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2421fe-70fc-4e24-985b-4ad3c6be4c77 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:28.304721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2421fe-70fc-4e24-985b-4ad3c6be4c77 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:28.306324 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 689/1358] 10.222.0.52 () {54 vars in 961 bytes} [Tue May 10 18:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:28.312248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce46456-0643-4a18-a14b-991f269630e5 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:28.312649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce46456-0643-4a18-a14b-991f269630e5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:28.313083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce46456-0643-4a18-a14b-991f269630e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:28.361441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5ce46456-0643-4a18-a14b-991f269630e5 None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:28.362859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5ce46456-0643-4a18-a14b-991f269630e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:28.447292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 670/1359] 10.222.0.52 () {58 vars in 1058 bytes} [Tue May 10 18:50:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:28.455891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2421fe-70fc-4e24-985b-4ad3c6be4c77 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:28.475542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2421fe-70fc-4e24-985b-4ad3c6be4c77 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:28.483108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba6579-4418-4ea1-af33-63b177e27e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:28.484073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba6579-4418-4ea1-af33-63b177e27e8a service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:28.484561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba6579-4418-4ea1-af33-63b177e27e8a service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:28.485192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba6579-4418-4ea1-af33-63b177e27e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:28.495184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba6579-4418-4ea1-af33-63b177e27e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:28.497042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba6579-4418-4ea1-af33-63b177e27e8a service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:28.507706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 690/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:30.943423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6637d-80d1-494e-adb9-f0b098d7bced None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:30.943960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6637d-80d1-494e-adb9-f0b098d7bced None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:30.944075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6637d-80d1-494e-adb9-f0b098d7bced None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:30.946076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 671/1361] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:30.951061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851bff5-5055-4a1f-99fd-876710dc924f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:30.951508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851bff5-5055-4a1f-99fd-876710dc924f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:30.951607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851bff5-5055-4a1f-99fd-876710dc924f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:30.970359 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7851bff5-5055-4a1f-99fd-876710dc924f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:30.971564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7851bff5-5055-4a1f-99fd-876710dc924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:30.980045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 691/1362] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:50:31.025546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6637d-80d1-494e-adb9-f0b098d7bced None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:31.043591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6637d-80d1-494e-adb9-f0b098d7bced None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:31.049566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27596e75-48f0-4c4b-b346-21207b315a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:31.050456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27596e75-48f0-4c4b-b346-21207b315a70 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:31.050925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27596e75-48f0-4c4b-b346-21207b315a70 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:31.051403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27596e75-48f0-4c4b-b346-21207b315a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:31.060558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27596e75-48f0-4c4b-b346-21207b315a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:31.062499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27596e75-48f0-4c4b-b346-21207b315a70 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:31.072619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 672/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:33.572294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d315a-0e68-413a-a41f-def545c31372 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:33.572817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d315a-0e68-413a-a41f-def545c31372 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:33.572957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d315a-0e68-413a-a41f-def545c31372 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:33.574260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 692/1364] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:33.580044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99887ac-4cb0-464c-b8f3-d2374bf46fea None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:33.580446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99887ac-4cb0-464c-b8f3-d2374bf46fea None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:33.580593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99887ac-4cb0-464c-b8f3-d2374bf46fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:33.599361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d99887ac-4cb0-464c-b8f3-d2374bf46fea None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:33.600926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d99887ac-4cb0-464c-b8f3-d2374bf46fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:33.609844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 673/1365] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:33.674866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d1786-4dc7-4132-9218-65642afce7b8 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:33.675154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d1786-4dc7-4132-9218-65642afce7b8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:33.675458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d1786-4dc7-4132-9218-65642afce7b8 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:33.676845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 693/1366] 10.222.0.52 () {54 vars in 961 bytes} [Tue May 10 18:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:33.682851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42538-f707-4bd5-8f16-2e34d2ddddb2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:33.683139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42538-f707-4bd5-8f16-2e34d2ddddb2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:33.683424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42538-f707-4bd5-8f16-2e34d2ddddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:33.702303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f6d42538-f707-4bd5-8f16-2e34d2ddddb2 None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:33.703553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f6d42538-f707-4bd5-8f16-2e34d2ddddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:33.713035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 674/1367] 10.222.0.52 () {58 vars in 1058 bytes} [Tue May 10 18:50:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:33.720656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d1786-4dc7-4132-9218-65642afce7b8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:33.735367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d1786-4dc7-4132-9218-65642afce7b8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:33.742396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44790efc-9bc1-4c76-9584-c5f502b1e275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:33.743130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790efc-9bc1-4c76-9584-c5f502b1e275 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:33.743499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790efc-9bc1-4c76-9584-c5f502b1e275 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:33.743837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790efc-9bc1-4c76-9584-c5f502b1e275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:33.752940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790efc-9bc1-4c76-9584-c5f502b1e275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:33.754606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790efc-9bc1-4c76-9584-c5f502b1e275 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:33.763972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 694/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:36.056292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266cc0c-f4c6-4265-8241-9f6667360434 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.056892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266cc0c-f4c6-4265-8241-9f6667360434 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.056892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266cc0c-f4c6-4265-8241-9f6667360434 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.058497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 675/1369] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:36.064075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e673e-a9e2-4dea-b230-6fd5a71db5ea None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.064488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e673e-a9e2-4dea-b230-6fd5a71db5ea None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.064721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e673e-a9e2-4dea-b230-6fd5a71db5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.083273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c58e673e-a9e2-4dea-b230-6fd5a71db5ea None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:36.084844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c58e673e-a9e2-4dea-b230-6fd5a71db5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:36.093575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 695/1370] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:36.137222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266cc0c-f4c6-4265-8241-9f6667360434 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:36.152221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266cc0c-f4c6-4265-8241-9f6667360434 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:36.160463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9953ed-3c18-41a3-84ae-6acdeb20204b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:36.161182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9953ed-3c18-41a3-84ae-6acdeb20204b service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.161441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9953ed-3c18-41a3-84ae-6acdeb20204b service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.161934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9953ed-3c18-41a3-84ae-6acdeb20204b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.171405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9953ed-3c18-41a3-84ae-6acdeb20204b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:36.174185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9953ed-3c18-41a3-84ae-6acdeb20204b service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:36.186536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 676/1371] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:36.344705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52953-5d3b-4250-97d8-fd27330be0c4 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.345455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52953-5d3b-4250-97d8-fd27330be0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.345956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52953-5d3b-4250-97d8-fd27330be0c4 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.349387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 696/1372] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:36.355157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dca23-7d57-4ddc-8a11-0b6112418a6f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.355825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dca23-7d57-4ddc-8a11-0b6112418a6f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.356359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dca23-7d57-4ddc-8a11-0b6112418a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.377436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ff0dca23-7d57-4ddc-8a11-0b6112418a6f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:36.379196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ff0dca23-7d57-4ddc-8a11-0b6112418a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:36.388579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 677/1373] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:36.696423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063e6f-19c5-4b37-a03f-122673833d41 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.696423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063e6f-19c5-4b37-a03f-122673833d41 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.696423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063e6f-19c5-4b37-a03f-122673833d41 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.697816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 697/1374] 10.222.0.52 () {54 vars in 963 bytes} [Tue May 10 18:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:36.702459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a869f-7c49-4de6-8f5f-00f72eda4129 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.702700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a869f-7c49-4de6-8f5f-00f72eda4129 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.703012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a869f-7c49-4de6-8f5f-00f72eda4129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.753072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-fd5a869f-7c49-4de6-8f5f-00f72eda4129 None None] MFA Rules not processed for user `b8cb476654be463e9d7d19d92576e495`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:36.754395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fd5a869f-7c49-4de6-8f5f-00f72eda4129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:36.814249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 678/1375] 10.222.0.52 () {58 vars in 1060 bytes} [Tue May 10 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:36.822107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063e6f-19c5-4b37-a03f-122673833d41 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:36.834069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063e6f-19c5-4b37-a03f-122673833d41 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:36.838031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd90b3-f261-4799-92d9-b0e37022d6e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:36.838766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd90b3-f261-4799-92d9-b0e37022d6e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:36.839123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd90b3-f261-4799-92d9-b0e37022d6e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:36.839477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd90b3-f261-4799-92d9-b0e37022d6e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:36.849878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd90b3-f261-4799-92d9-b0e37022d6e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:36.851412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd90b3-f261-4799-92d9-b0e37022d6e4 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:36.861355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 698/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:38.464591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0417a-4ba8-471a-bae7-311977f78902 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:38.465268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0417a-4ba8-471a-bae7-311977f78902 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:38.465268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0417a-4ba8-471a-bae7-311977f78902 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:38.466600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 679/1377] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:38.472899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f2ca-1c8d-4fee-a4f7-84e0ee4a8f1d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:38.473841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f2ca-1c8d-4fee-a4f7-84e0ee4a8f1d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:38.474429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f2ca-1c8d-4fee-a4f7-84e0ee4a8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:38.498728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ec35f2ca-1c8d-4fee-a4f7-84e0ee4a8f1d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:38.499968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ec35f2ca-1c8d-4fee-a4f7-84e0ee4a8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:38.509457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 699/1378] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:38.555277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0417a-4ba8-471a-bae7-311977f78902 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:38.570434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0417a-4ba8-471a-bae7-311977f78902 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:38.576993 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248548-5018-42cb-bc63-037aa7a73b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:38.577663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248548-5018-42cb-bc63-037aa7a73b85 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:38.577943 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248548-5018-42cb-bc63-037aa7a73b85 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:38.578218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248548-5018-42cb-bc63-037aa7a73b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:38.587315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14248548-5018-42cb-bc63-037aa7a73b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:38.588978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14248548-5018-42cb-bc63-037aa7a73b85 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:38.598857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 680/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:50:40.890604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447c32-cf77-4a4c-b1cc-a0a97e482b7c None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:40.891215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447c32-cf77-4a4c-b1cc-a0a97e482b7c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:40.891215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447c32-cf77-4a4c-b1cc-a0a97e482b7c None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:40.892492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 700/1380] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:40.898031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59448e8-7a85-4790-ba2b-86e6f08fec2d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:40.898465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59448e8-7a85-4790-ba2b-86e6f08fec2d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:40.898656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59448e8-7a85-4790-ba2b-86e6f08fec2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:40.916925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b59448e8-7a85-4790-ba2b-86e6f08fec2d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:40.918424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b59448e8-7a85-4790-ba2b-86e6f08fec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:40.926843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 681/1381] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:40.971285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447c32-cf77-4a4c-b1cc-a0a97e482b7c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:40.987131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447c32-cf77-4a4c-b1cc-a0a97e482b7c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:40.993228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800496ab-fc20-4539-b3be-256f10049228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:40.993880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800496ab-fc20-4539-b3be-256f10049228 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:40.994165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800496ab-fc20-4539-b3be-256f10049228 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:40.994438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800496ab-fc20-4539-b3be-256f10049228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:41.003622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800496ab-fc20-4539-b3be-256f10049228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:41.005232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800496ab-fc20-4539-b3be-256f10049228 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:41.015052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 701/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:43.263844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a790aee-4324-4dbc-b4f5-ce66a011e1d9 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:43.264970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a790aee-4324-4dbc-b4f5-ce66a011e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:43.265327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a790aee-4324-4dbc-b4f5-ce66a011e1d9 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:43.267226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 682/1383] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:43.273703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a96b9-56d6-4d8b-89af-8d14601c1f44 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:43.274281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a96b9-56d6-4d8b-89af-8d14601c1f44 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:43.274281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a96b9-56d6-4d8b-89af-8d14601c1f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:43.292990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2f1a96b9-56d6-4d8b-89af-8d14601c1f44 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:43.294185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2f1a96b9-56d6-4d8b-89af-8d14601c1f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:43.302739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 702/1384] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:43.344263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a790aee-4324-4dbc-b4f5-ce66a011e1d9 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:43.360626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a790aee-4324-4dbc-b4f5-ce66a011e1d9 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:43.367082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19f2e-b9c6-44bb-96c8-4355478fd31c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:43.367897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19f2e-b9c6-44bb-96c8-4355478fd31c service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:43.368271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19f2e-b9c6-44bb-96c8-4355478fd31c service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:43.368693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19f2e-b9c6-44bb-96c8-4355478fd31c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:43.378154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19f2e-b9c6-44bb-96c8-4355478fd31c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:43.379914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19f2e-b9c6-44bb-96c8-4355478fd31c service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:43.390620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 683/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:45.621321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2962d8-204f-4c58-b96f-f17281cf8d70 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:45.621934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2962d8-204f-4c58-b96f-f17281cf8d70 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:45.622063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2962d8-204f-4c58-b96f-f17281cf8d70 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:45.624153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 703/1386] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:45.632227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be5b89-3962-47cd-be39-2df31e055710 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:45.632764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be5b89-3962-47cd-be39-2df31e055710 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:45.632865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be5b89-3962-47cd-be39-2df31e055710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:45.652921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c3be5b89-3962-47cd-be39-2df31e055710 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:45.654109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c3be5b89-3962-47cd-be39-2df31e055710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:45.662454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 684/1387] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:45.709861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2962d8-204f-4c58-b96f-f17281cf8d70 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:45.727378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2962d8-204f-4c58-b96f-f17281cf8d70 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:45.733864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5fae-fb08-4d9a-ad88-c1f650b79415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:45.734544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5fae-fb08-4d9a-ad88-c1f650b79415 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:45.734838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5fae-fb08-4d9a-ad88-c1f650b79415 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:45.735115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5fae-fb08-4d9a-ad88-c1f650b79415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:45.743718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e5fae-fb08-4d9a-ad88-c1f650b79415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:45.745427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e5fae-fb08-4d9a-ad88-c1f650b79415 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:45.755155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 704/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:48.528295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665792-0c2d-42b0-9633-e407585b1a4e None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:48.528943 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665792-0c2d-42b0-9633-e407585b1a4e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:48.528943 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665792-0c2d-42b0-9633-e407585b1a4e None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:48.530339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 685/1389] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:48.536202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d389f7-4b86-4f48-bfec-f97f794f5bec None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:48.536871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d389f7-4b86-4f48-bfec-f97f794f5bec None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:48.536871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d389f7-4b86-4f48-bfec-f97f794f5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:48.556226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-36d389f7-4b86-4f48-bfec-f97f794f5bec None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:48.557549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-36d389f7-4b86-4f48-bfec-f97f794f5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:48.565927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 705/1390] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:48.613182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98665792-0c2d-42b0-9633-e407585b1a4e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:48.629176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98665792-0c2d-42b0-9633-e407585b1a4e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:48.634709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03303066-4cde-4b76-acc0-8b8cba0b6ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:48.635388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303066-4cde-4b76-acc0-8b8cba0b6ff5 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:48.635664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303066-4cde-4b76-acc0-8b8cba0b6ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:48.635934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303066-4cde-4b76-acc0-8b8cba0b6ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:48.644736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03303066-4cde-4b76-acc0-8b8cba0b6ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:48.646478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03303066-4cde-4b76-acc0-8b8cba0b6ff5 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:48.655987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 686/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:50.946478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a903ce-c9a8-4004-832d-d123d670ee1a None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:50.947124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a903ce-c9a8-4004-832d-d123d670ee1a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:50.947124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a903ce-c9a8-4004-832d-d123d670ee1a None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:50.948379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 706/1392] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:50.954000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a863c-09b7-4ec3-a54b-5cfed859ca1c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:50.954492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a863c-09b7-4ec3-a54b-5cfed859ca1c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:50.954492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a863c-09b7-4ec3-a54b-5cfed859ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:50.973236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f33a863c-09b7-4ec3-a54b-5cfed859ca1c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:50.974449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f33a863c-09b7-4ec3-a54b-5cfed859ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:50.983676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 687/1393] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:51.028573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a903ce-c9a8-4004-832d-d123d670ee1a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:51.043821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a903ce-c9a8-4004-832d-d123d670ee1a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:51.049924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3e4c-123d-4dcf-8154-38f72c3e8fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:51.050578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3e4c-123d-4dcf-8154-38f72c3e8fa7 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:51.050861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3e4c-123d-4dcf-8154-38f72c3e8fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:51.051140 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3e4c-123d-4dcf-8154-38f72c3e8fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:51.060285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c3e4c-123d-4dcf-8154-38f72c3e8fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:51.061923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c3e4c-123d-4dcf-8154-38f72c3e8fa7 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:51.071794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 707/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:52.477765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12501-2e70-46bc-8374-67557ba80f17 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:52.478298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12501-2e70-46bc-8374-67557ba80f17 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:52.478298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12501-2e70-46bc-8374-67557ba80f17 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:52.479715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 688/1395] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:52.485334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2852d7-71b6-44a4-ac23-8d0709367dbf None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:52.485781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2852d7-71b6-44a4-ac23-8d0709367dbf None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:52.485891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2852d7-71b6-44a4-ac23-8d0709367dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:52.504140 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8d2852d7-71b6-44a4-ac23-8d0709367dbf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:52.505372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8d2852d7-71b6-44a4-ac23-8d0709367dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:52.513878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 708/1396] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:52.569551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1a92f-16cb-4d28-abbb-04ff1b231d4d None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:52.569847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1a92f-16cb-4d28-abbb-04ff1b231d4d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:52.570124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1a92f-16cb-4d28-abbb-04ff1b231d4d None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:52.571533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 689/1397] 10.222.0.52 () {54 vars in 962 bytes} [Tue May 10 18:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:52.577030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdbbe-424a-4140-a513-1437110e9924 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:52.577405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdbbe-424a-4140-a513-1437110e9924 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:52.577753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdbbe-424a-4140-a513-1437110e9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:52.627183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-115cdbbe-424a-4140-a513-1437110e9924 None None] MFA Rules not processed for user `8650bbea186e427fac890eabe18ba153`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:52.628811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-115cdbbe-424a-4140-a513-1437110e9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:52.688849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 709/1398] 10.222.0.52 () {58 vars in 1059 bytes} [Tue May 10 18:50:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:52.696521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1a92f-16cb-4d28-abbb-04ff1b231d4d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:52.708264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1a92f-16cb-4d28-abbb-04ff1b231d4d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:52.712707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f403077-348a-400c-9c18-2123be1eee18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:52.713349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403077-348a-400c-9c18-2123be1eee18 service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:52.713629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403077-348a-400c-9c18-2123be1eee18 service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:52.713901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403077-348a-400c-9c18-2123be1eee18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:52.723956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f403077-348a-400c-9c18-2123be1eee18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:52.725537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f403077-348a-400c-9c18-2123be1eee18 service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:52.735532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 690/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:50:53.152862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c5043-dead-4789-9743-ceea07df82b5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:53.153150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c5043-dead-4789-9743-ceea07df82b5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:53.153436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c5043-dead-4789-9743-ceea07df82b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:53.200587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7e9c5043-dead-4789-9743-ceea07df82b5 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:53.201813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7e9c5043-dead-4789-9743-ceea07df82b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:53.266408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 710/1400] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:53.288605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f352e-d011-4bfe-a64d-c6b0beeb7fcf None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:53.288922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f352e-d011-4bfe-a64d-c6b0beeb7fcf None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:53.289269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f352e-d011-4bfe-a64d-c6b0beeb7fcf None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:53.290586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 691/1401] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:53.296179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308918c2-e47f-402d-b492-9843675f91a7 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:53.296469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308918c2-e47f-402d-b492-9843675f91a7 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:53.296810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308918c2-e47f-402d-b492-9843675f91a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:53.313494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ffc7-3364-4f76-843f-400eaf54c10d None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:53.313836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ffc7-3364-4f76-843f-400eaf54c10d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:53.314200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655ffc7-3364-4f76-843f-400eaf54c10d None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:53.315657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 692/1402] 10.222.0.52 () {54 vars in 942 bytes} [Tue May 10 18:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:50:53.317469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-308918c2-e47f-402d-b492-9843675f91a7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:53.318703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-308918c2-e47f-402d-b492-9843675f91a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:53.322256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69583406-99fa-4ff9-8634-927b0e121679 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:53.322608 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69583406-99fa-4ff9-8634-927b0e121679 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:53.322953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69583406-99fa-4ff9-8634-927b0e121679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:53.327546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 711/1403] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:53.370575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308918c2-e47f-402d-b492-9843675f91a7 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:53.372293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-69583406-99fa-4ff9-8634-927b0e121679 None None] MFA Rules not processed for user `a9e110bec628462e8699b8681daf2d58`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:53.373525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-69583406-99fa-4ff9-8634-927b0e121679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:53.383268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308918c2-e47f-402d-b492-9843675f91a7 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:53.389051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:53.389701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:53.389982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:53.390257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:53.398359 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:53.399944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:53.409234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 712/1404] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:50:53.446465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 693/1405] 10.222.0.52 () {58 vars in 1039 bytes} [Tue May 10 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:50:53.456656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:53.469311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ede60-c1fb-464b-b31a-3913c2b94e50 service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:53.475453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1fed2-ba07-4c7c-97fa-fa8b954726fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:53.476108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fed2-ba07-4c7c-97fa-fa8b954726fa service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:53.476389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fed2-ba07-4c7c-97fa-fa8b954726fa service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:53.476721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fed2-ba07-4c7c-97fa-fa8b954726fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:53.486223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1fed2-ba07-4c7c-97fa-fa8b954726fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:53.487855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1fed2-ba07-4c7c-97fa-fa8b954726fa service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:53.497089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 713/1406] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 18:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 18:50:55.688067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a673af-ddae-4682-904e-4f934f3519e6 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:55.688644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a673af-ddae-4682-904e-4f934f3519e6 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:55.688893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a673af-ddae-4682-904e-4f934f3519e6 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:55.690393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 694/1407] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:50:55.695900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75bfe3-9107-460f-b6d3-a8a9adac9ed6 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:55.696753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75bfe3-9107-460f-b6d3-a8a9adac9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:55.697251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75bfe3-9107-460f-b6d3-a8a9adac9ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:55.718027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-dc75bfe3-9107-460f-b6d3-a8a9adac9ed6 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:50:55.719612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-dc75bfe3-9107-460f-b6d3-a8a9adac9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:50:55.728433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 714/1408] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:50:55.776738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a673af-ddae-4682-904e-4f934f3519e6 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:50:55.791248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a673af-ddae-4682-904e-4f934f3519e6 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:50:55.796828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ae1da-c2f4-467a-bf93-56fba2123788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:50:55.797472 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae1da-c2f4-467a-bf93-56fba2123788 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:50:55.797741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae1da-c2f4-467a-bf93-56fba2123788 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:50:55.798015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae1da-c2f4-467a-bf93-56fba2123788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:50:55.806004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ae1da-c2f4-467a-bf93-56fba2123788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:50:55.808140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ae1da-c2f4-467a-bf93-56fba2123788 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:50:55.817729 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 695/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:16.933189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ec8c-f9a1-420c-b062-145d102392e0 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:16.933864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ec8c-f9a1-420c-b062-145d102392e0 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:16.933864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ec8c-f9a1-420c-b062-145d102392e0 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:16.935095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 715/1410] 10.222.0.52 () {54 vars in 918 bytes} [Tue May 10 18:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:16.941245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0070-2772-408c-9272-ddfe1a10cf93 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:16.941743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0070-2772-408c-9272-ddfe1a10cf93 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:16.941850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0070-2772-408c-9272-ddfe1a10cf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:16.965389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5d7b0070-2772-408c-9272-ddfe1a10cf93 None None] MFA Rules not processed for user `698df68d01c641c1b4455509d798d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:16.966598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5d7b0070-2772-408c-9272-ddfe1a10cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:16.975983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 696/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Tue May 10 18:51:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:16.990485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d96699-68e5-4f2a-ba37-5dbc96d91fa0 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:16.990820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d96699-68e5-4f2a-ba37-5dbc96d91fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:16.991102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d96699-68e5-4f2a-ba37-5dbc96d91fa0 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:16.992473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 716/1412] 10.222.0.52 () {54 vars in 918 bytes} [Tue May 10 18:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:16.997198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12798-8313-4697-b10e-320b65e6d457 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:16.997502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12798-8313-4697-b10e-320b65e6d457 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:16.997750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12798-8313-4697-b10e-320b65e6d457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:17.017549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-34a12798-8313-4697-b10e-320b65e6d457 None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:17.018744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-34a12798-8313-4697-b10e-320b65e6d457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:17.029587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 697/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Tue May 10 18:51:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:19.726274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5875537-ed86-4593-a3c5-684257e7e701 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:19.726854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5875537-ed86-4593-a3c5-684257e7e701 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:19.726854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5875537-ed86-4593-a3c5-684257e7e701 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:19.728248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:19.733708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2683-45fa-4f30-b935-2f15f7dcd7ab None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:19.734254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2683-45fa-4f30-b935-2f15f7dcd7ab None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:19.734254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2683-45fa-4f30-b935-2f15f7dcd7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:19.752889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d70b2683-45fa-4f30-b935-2f15f7dcd7ab None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:19.754456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d70b2683-45fa-4f30-b935-2f15f7dcd7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:19.763168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:19.808492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5875537-ed86-4593-a3c5-684257e7e701 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:19.827289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5875537-ed86-4593-a3c5-684257e7e701 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:19.833174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7996d-290c-4c87-adf1-e464a1cf9fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:19.833813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7996d-290c-4c87-adf1-e464a1cf9fea service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:19.834090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7996d-290c-4c87-adf1-e464a1cf9fea service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:19.834384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7996d-290c-4c87-adf1-e464a1cf9fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:19.842632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7996d-290c-4c87-adf1-e464a1cf9fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:19.844207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7996d-290c-4c87-adf1-e464a1cf9fea service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:19.853930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 718/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:20.853236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbff41-d06a-4991-a104-82ab8ead161e None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:20.853808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbff41-d06a-4991-a104-82ab8ead161e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:20.853808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbff41-d06a-4991-a104-82ab8ead161e None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:20.855072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:20.861469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd609e-d0c7-4a30-ae4f-926e75f39885 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:20.862235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd609e-d0c7-4a30-ae4f-926e75f39885 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:20.862431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd609e-d0c7-4a30-ae4f-926e75f39885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:20.883739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8dcd609e-d0c7-4a30-ae4f-926e75f39885 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:20.885023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8dcd609e-d0c7-4a30-ae4f-926e75f39885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:20.893774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:21.070731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbff41-d06a-4991-a104-82ab8ead161e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:21.088295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbff41-d06a-4991-a104-82ab8ead161e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:21.095226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682618a-fe41-450c-ad0d-5748727f26ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:21.095861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682618a-fe41-450c-ad0d-5748727f26ce service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:21.096146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682618a-fe41-450c-ad0d-5748727f26ce service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:21.096416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682618a-fe41-450c-ad0d-5748727f26ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:21.105757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682618a-fe41-450c-ad0d-5748727f26ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:21.107300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682618a-fe41-450c-ad0d-5748727f26ce service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:21.117593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 700/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:51:22.087686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c6b7-25ec-4673-8486-b1772c4a7cb5 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:22.088496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c6b7-25ec-4673-8486-b1772c4a7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:22.088643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c6b7-25ec-4673-8486-b1772c4a7cb5 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:22.090884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:22.098619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3867a-00ce-4ce8-bf04-8c0797397463 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:22.099089 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3867a-00ce-4ce8-bf04-8c0797397463 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:22.099196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3867a-00ce-4ce8-bf04-8c0797397463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:22.117611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-82c3867a-00ce-4ce8-bf04-8c0797397463 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:22.118799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-82c3867a-00ce-4ce8-bf04-8c0797397463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:22.127234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:22.278327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c6b7-25ec-4673-8486-b1772c4a7cb5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:22.302995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c6b7-25ec-4673-8486-b1772c4a7cb5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:22.309845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c82d60-375f-4b96-a8fb-482149c5b70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:22.310485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c82d60-375f-4b96-a8fb-482149c5b70d service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:22.310760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c82d60-375f-4b96-a8fb-482149c5b70d service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:22.311028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c82d60-375f-4b96-a8fb-482149c5b70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:22.319633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c82d60-375f-4b96-a8fb-482149c5b70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:22.321249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c82d60-375f-4b96-a8fb-482149c5b70d service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:22.330956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 721/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:23.264503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db776-1a3f-4d68-bfe4-8871a98ed593 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:23.265127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db776-1a3f-4d68-bfe4-8871a98ed593 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:23.265127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db776-1a3f-4d68-bfe4-8871a98ed593 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:23.267242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:23.272984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924d09-98fa-41ff-8e06-00eed8fab49f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:23.273437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924d09-98fa-41ff-8e06-00eed8fab49f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:23.273532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924d09-98fa-41ff-8e06-00eed8fab49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:23.294451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-53924d09-98fa-41ff-8e06-00eed8fab49f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:23.295657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-53924d09-98fa-41ff-8e06-00eed8fab49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:23.305430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:23.455799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545db776-1a3f-4d68-bfe4-8871a98ed593 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:23.477568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545db776-1a3f-4d68-bfe4-8871a98ed593 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:23.483467 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f193ee-401b-45af-830c-7d3e43bcfbdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:23.484105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f193ee-401b-45af-830c-7d3e43bcfbdb service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:23.484383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f193ee-401b-45af-830c-7d3e43bcfbdb service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:23.484654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f193ee-401b-45af-830c-7d3e43bcfbdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:23.493301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f193ee-401b-45af-830c-7d3e43bcfbdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:23.494872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f193ee-401b-45af-830c-7d3e43bcfbdb service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:23.504708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 703/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:24.423300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c2417-558c-4d78-8118-06fd7a342b33 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:24.424123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c2417-558c-4d78-8118-06fd7a342b33 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:24.424123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c2417-558c-4d78-8118-06fd7a342b33 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:24.425263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:51:24.430805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff28ef-989e-40eb-821b-72a435d13e44 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:24.431306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff28ef-989e-40eb-821b-72a435d13e44 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:24.431306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff28ef-989e-40eb-821b-72a435d13e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:24.451603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9bff28ef-989e-40eb-821b-72a435d13e44 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:24.452879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9bff28ef-989e-40eb-821b-72a435d13e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:24.462023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:24.624039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c2417-558c-4d78-8118-06fd7a342b33 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:24.648466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c2417-558c-4d78-8118-06fd7a342b33 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:24.655576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51d619-db0a-4c73-8179-356b11c9189c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:24.656231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d619-db0a-4c73-8179-356b11c9189c service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:24.656515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d619-db0a-4c73-8179-356b11c9189c service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:24.656830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d619-db0a-4c73-8179-356b11c9189c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:24.665030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51d619-db0a-4c73-8179-356b11c9189c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:24.666629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51d619-db0a-4c73-8179-356b11c9189c service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:24.676156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 724/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:25.552961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607d6-d7c6-4589-9b54-d483e2a1f3e5 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:25.553532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607d6-d7c6-4589-9b54-d483e2a1f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:25.553651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607d6-d7c6-4589-9b54-d483e2a1f3e5 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:25.555003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:25.560401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54978-0f91-442e-9092-7d952566854a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:25.560973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54978-0f91-442e-9092-7d952566854a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:25.560973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54978-0f91-442e-9092-7d952566854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:25.580896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-21d54978-0f91-442e-9092-7d952566854a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:25.582101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-21d54978-0f91-442e-9092-7d952566854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:25.590705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:51:25.741869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c607d6-d7c6-4589-9b54-d483e2a1f3e5 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:25.759103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c607d6-d7c6-4589-9b54-d483e2a1f3e5 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:25.769768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a21ae3-2c0e-4c98-bbaa-765b80b0e6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:25.770687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21ae3-2c0e-4c98-bbaa-765b80b0e6ea service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:25.771056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21ae3-2c0e-4c98-bbaa-765b80b0e6ea service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:25.771346 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21ae3-2c0e-4c98-bbaa-765b80b0e6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:25.784804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a21ae3-2c0e-4c98-bbaa-765b80b0e6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:25.787339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a21ae3-2c0e-4c98-bbaa-765b80b0e6ea service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:25.796884 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 706/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:26.662032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cda3-c670-4c72-9461-36bed74215fe None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:26.662944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cda3-c670-4c72-9461-36bed74215fe None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:26.662944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cda3-c670-4c72-9461-36bed74215fe None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:26.665165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:26.671178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb784-8aa3-4181-bae7-15d1150f1c11 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:26.671862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb784-8aa3-4181-bae7-15d1150f1c11 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:26.672050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb784-8aa3-4181-bae7-15d1150f1c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:26.694454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-910cb784-8aa3-4181-bae7-15d1150f1c11 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:26.695677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-910cb784-8aa3-4181-bae7-15d1150f1c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:26.705182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:26.857609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197cda3-c670-4c72-9461-36bed74215fe None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:26.880296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197cda3-c670-4c72-9461-36bed74215fe None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:26.887611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd491a09-f150-4aed-94ef-d46fda94c44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:26.888253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491a09-f150-4aed-94ef-d46fda94c44b service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:26.888530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491a09-f150-4aed-94ef-d46fda94c44b service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:26.888834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491a09-f150-4aed-94ef-d46fda94c44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:26.898076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd491a09-f150-4aed-94ef-d46fda94c44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:26.899644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd491a09-f150-4aed-94ef-d46fda94c44b service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:26.909930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 727/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:27.782012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d141b0-7011-4920-9bca-6b014878ec3d None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:27.782575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d141b0-7011-4920-9bca-6b014878ec3d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:27.782575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d141b0-7011-4920-9bca-6b014878ec3d None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:27.783863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:27.790025 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ef71-0408-4e2a-8b05-f5fc3927acf8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:27.790691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ef71-0408-4e2a-8b05-f5fc3927acf8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:27.790832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ef71-0408-4e2a-8b05-f5fc3927acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:27.820237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-56a6ef71-0408-4e2a-8b05-f5fc3927acf8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:27.821484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-56a6ef71-0408-4e2a-8b05-f5fc3927acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:27.830748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:27.986158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d141b0-7011-4920-9bca-6b014878ec3d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:28.012159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d141b0-7011-4920-9bca-6b014878ec3d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:28.019378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc3b4d-1928-499f-b189-083fa57838a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:28.020016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3b4d-1928-499f-b189-083fa57838a8 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:28.020288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3b4d-1928-499f-b189-083fa57838a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:28.020554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3b4d-1928-499f-b189-083fa57838a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:28.030049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc3b4d-1928-499f-b189-083fa57838a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:28.031631 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc3b4d-1928-499f-b189-083fa57838a8 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:28.041559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 709/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:28.906604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc74e32-d207-4ec2-b62f-85f133992400 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:28.907205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc74e32-d207-4ec2-b62f-85f133992400 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:28.907205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc74e32-d207-4ec2-b62f-85f133992400 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:28.908528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:28.914725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33fc8-39c4-4eb8-82f3-a78bf4d9af1e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:28.915449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33fc8-39c4-4eb8-82f3-a78bf4d9af1e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:28.915580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33fc8-39c4-4eb8-82f3-a78bf4d9af1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:28.938496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-04f33fc8-39c4-4eb8-82f3-a78bf4d9af1e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:28.939684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-04f33fc8-39c4-4eb8-82f3-a78bf4d9af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:28.948447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:29.101996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc74e32-d207-4ec2-b62f-85f133992400 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:29.119724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc74e32-d207-4ec2-b62f-85f133992400 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:29.127189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c2d2f-d0b9-4c2f-8b43-a717ca27f539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:29.127830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2d2f-d0b9-4c2f-8b43-a717ca27f539 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:29.128108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2d2f-d0b9-4c2f-8b43-a717ca27f539 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:29.128707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2d2f-d0b9-4c2f-8b43-a717ca27f539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:29.137130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c2d2f-d0b9-4c2f-8b43-a717ca27f539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:29.138707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c2d2f-d0b9-4c2f-8b43-a717ca27f539 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:29.148467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 730/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:31.226307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdcf28-28cd-494d-a898-759d9ac2f9c0 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:31.226857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdcf28-28cd-494d-a898-759d9ac2f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:31.226857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdcf28-28cd-494d-a898-759d9ac2f9c0 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:31.228906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:31.234698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7f56-aa08-4056-9f24-787ed362aec0 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:31.235162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7f56-aa08-4056-9f24-787ed362aec0 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:31.235268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7f56-aa08-4056-9f24-787ed362aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:31.254886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2f6b7f56-aa08-4056-9f24-787ed362aec0 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:31.256082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2f6b7f56-aa08-4056-9f24-787ed362aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:31.265087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:31.302702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdcf28-28cd-494d-a898-759d9ac2f9c0 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:31.315402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdcf28-28cd-494d-a898-759d9ac2f9c0 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:31.319427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77769c-47d9-4eac-8731-df89cdeba517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:31.320072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77769c-47d9-4eac-8731-df89cdeba517 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:31.320349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77769c-47d9-4eac-8731-df89cdeba517 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:31.320612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77769c-47d9-4eac-8731-df89cdeba517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:31.330403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77769c-47d9-4eac-8731-df89cdeba517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:31.331842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77769c-47d9-4eac-8731-df89cdeba517 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:31.341314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 712/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:33.691127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e38cb-01a0-4ca5-bdc6-5dfe3fadec36 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:33.691715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e38cb-01a0-4ca5-bdc6-5dfe3fadec36 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:33.691715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e38cb-01a0-4ca5-bdc6-5dfe3fadec36 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:33.693089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:33.698660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8f294-d386-45af-b0b1-e793d84854c2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:33.699088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8f294-d386-45af-b0b1-e793d84854c2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:33.699202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8f294-d386-45af-b0b1-e793d84854c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:33.721149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-10a8f294-d386-45af-b0b1-e793d84854c2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:33.722279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-10a8f294-d386-45af-b0b1-e793d84854c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:33.731482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:33.769241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e38cb-01a0-4ca5-bdc6-5dfe3fadec36 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:33.781737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e38cb-01a0-4ca5-bdc6-5dfe3fadec36 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:33.786069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ba72-598a-4f9a-8d84-7d4976b6297e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:33.786722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ba72-598a-4f9a-8d84-7d4976b6297e service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:33.786990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ba72-598a-4f9a-8d84-7d4976b6297e service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:33.787266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ba72-598a-4f9a-8d84-7d4976b6297e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:33.796503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ba72-598a-4f9a-8d84-7d4976b6297e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:33.797974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ba72-598a-4f9a-8d84-7d4976b6297e service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:33.807421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 733/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:36.349904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9668-3609-4859-9d41-d80688647c75 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:36.350569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9668-3609-4859-9d41-d80688647c75 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:36.350569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9668-3609-4859-9d41-d80688647c75 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:36.351830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:36.358383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715fcc6-0ddb-4b68-b79d-3003a53849c4 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:36.359116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715fcc6-0ddb-4b68-b79d-3003a53849c4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:36.359264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715fcc6-0ddb-4b68-b79d-3003a53849c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:36.384941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e715fcc6-0ddb-4b68-b79d-3003a53849c4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:36.386203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e715fcc6-0ddb-4b68-b79d-3003a53849c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:36.395390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:36.443686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9668-3609-4859-9d41-d80688647c75 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:36.456335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9668-3609-4859-9d41-d80688647c75 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:36.460887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df5598-4469-4bd0-a08d-a0c05708d308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:36.461536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5598-4469-4bd0-a08d-a0c05708d308 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:36.461817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5598-4469-4bd0-a08d-a0c05708d308 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:36.462091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5598-4469-4bd0-a08d-a0c05708d308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:36.471542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df5598-4469-4bd0-a08d-a0c05708d308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:36.473061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df5598-4469-4bd0-a08d-a0c05708d308 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:36.482919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 715/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:38.917717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e588fb-af6e-4cc5-9604-1ae06fbdb09f None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:38.918356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e588fb-af6e-4cc5-9604-1ae06fbdb09f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:38.918356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e588fb-af6e-4cc5-9604-1ae06fbdb09f None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:38.919738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:38.925433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af799384-0da9-4fd6-a1be-fcc78c064bc9 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:38.925880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af799384-0da9-4fd6-a1be-fcc78c064bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:38.926010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af799384-0da9-4fd6-a1be-fcc78c064bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:38.944423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-af799384-0da9-4fd6-a1be-fcc78c064bc9 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:38.945661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-af799384-0da9-4fd6-a1be-fcc78c064bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:38.959986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:39.002264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e588fb-af6e-4cc5-9604-1ae06fbdb09f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:39.018631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e588fb-af6e-4cc5-9604-1ae06fbdb09f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:39.024478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d395a-554d-4d96-a03c-1ae1d474ab9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:39.025157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d395a-554d-4d96-a03c-1ae1d474ab9b service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:39.025440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d395a-554d-4d96-a03c-1ae1d474ab9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:39.025705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d395a-554d-4d96-a03c-1ae1d474ab9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:39.035013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d395a-554d-4d96-a03c-1ae1d474ab9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:39.036412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d395a-554d-4d96-a03c-1ae1d474ab9b service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:39.046110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 736/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:41.334549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e53-8fdd-44f8-92f3-507fa1a89118 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:41.335193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e53-8fdd-44f8-92f3-507fa1a89118 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:41.335193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e53-8fdd-44f8-92f3-507fa1a89118 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:41.336495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:41.342984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e95a1-7ced-4450-a4d5-eaab4786abd5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:41.343729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e95a1-7ced-4450-a4d5-eaab4786abd5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:41.343880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e95a1-7ced-4450-a4d5-eaab4786abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:41.365252 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6b8e95a1-7ced-4450-a4d5-eaab4786abd5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:41.366473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6b8e95a1-7ced-4450-a4d5-eaab4786abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:41.375896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:41.413827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e53-8fdd-44f8-92f3-507fa1a89118 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:41.425896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e53-8fdd-44f8-92f3-507fa1a89118 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:41.430537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed982-fa03-4cd8-aa3a-f2c7c35022a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:41.431179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed982-fa03-4cd8-aa3a-f2c7c35022a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:41.431457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed982-fa03-4cd8-aa3a-f2c7c35022a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:41.431725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed982-fa03-4cd8-aa3a-f2c7c35022a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:41.441330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ed982-fa03-4cd8-aa3a-f2c7c35022a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:41.442763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ed982-fa03-4cd8-aa3a-f2c7c35022a0 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:41.452129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 718/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:43.724633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356083-6df9-4650-91eb-1b54403e9f3c None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:43.725507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356083-6df9-4650-91eb-1b54403e9f3c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:43.725507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356083-6df9-4650-91eb-1b54403e9f3c None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:43.726894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:43.733156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20412d-9e4e-4e08-8824-26927ca930d8 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:43.733606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20412d-9e4e-4e08-8824-26927ca930d8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:43.733724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20412d-9e4e-4e08-8824-26927ca930d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:43.760358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ee20412d-9e4e-4e08-8824-26927ca930d8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:43.761657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ee20412d-9e4e-4e08-8824-26927ca930d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:43.771087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:43.809661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62356083-6df9-4650-91eb-1b54403e9f3c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:43.822246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62356083-6df9-4650-91eb-1b54403e9f3c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:43.826038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc397a9-850b-4232-a64d-40885e8a431e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:43.826652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc397a9-850b-4232-a64d-40885e8a431e service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:43.826934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc397a9-850b-4232-a64d-40885e8a431e service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:43.827203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc397a9-850b-4232-a64d-40885e8a431e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:43.836555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc397a9-850b-4232-a64d-40885e8a431e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:43.838019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc397a9-850b-4232-a64d-40885e8a431e service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:43.847407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 739/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:46.098671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca930-6053-4e27-8f2f-6100f0a6c031 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:46.099274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca930-6053-4e27-8f2f-6100f0a6c031 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:46.099274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca930-6053-4e27-8f2f-6100f0a6c031 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:46.100732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:46.107341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554a82-345f-4a47-bcd0-52f2954da19f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:46.107800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554a82-345f-4a47-bcd0-52f2954da19f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:46.107902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15554a82-345f-4a47-bcd0-52f2954da19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:46.134126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-15554a82-345f-4a47-bcd0-52f2954da19f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:46.135358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-15554a82-345f-4a47-bcd0-52f2954da19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:46.143816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:46.183041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ca930-6053-4e27-8f2f-6100f0a6c031 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:46.202150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ca930-6053-4e27-8f2f-6100f0a6c031 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:46.208734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dd284-d502-4314-b1ac-248afa42201d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:46.209796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd284-d502-4314-b1ac-248afa42201d service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:46.210084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd284-d502-4314-b1ac-248afa42201d service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:46.210356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd284-d502-4314-b1ac-248afa42201d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:46.220305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dd284-d502-4314-b1ac-248afa42201d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:46.221794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dd284-d502-4314-b1ac-248afa42201d service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:46.231559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 721/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:48.482329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74e66-e6bc-48de-9323-c8cf14d8db83 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:48.483512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74e66-e6bc-48de-9323-c8cf14d8db83 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:48.483512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74e66-e6bc-48de-9323-c8cf14d8db83 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:48.485504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:48.491083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a33e-0dc6-49d1-bd99-8e09e106eaed None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:48.491561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a33e-0dc6-49d1-bd99-8e09e106eaed None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:48.491656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a33e-0dc6-49d1-bd99-8e09e106eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:48.511575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-06e4a33e-0dc6-49d1-bd99-8e09e106eaed None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:48.512835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-06e4a33e-0dc6-49d1-bd99-8e09e106eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:48.521847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:48.572910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e74e66-e6bc-48de-9323-c8cf14d8db83 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:48.589021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e74e66-e6bc-48de-9323-c8cf14d8db83 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:48.593669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9c156-e453-4881-aa57-621ef164d579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:48.594290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c156-e453-4881-aa57-621ef164d579 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:48.594581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c156-e453-4881-aa57-621ef164d579 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:48.594851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c156-e453-4881-aa57-621ef164d579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:48.604715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9c156-e453-4881-aa57-621ef164d579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:48.606145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9c156-e453-4881-aa57-621ef164d579 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:48.616016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 742/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:50.865427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c911-423b-4c5f-bd3b-c6f7e2d3e766 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:50.866135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c911-423b-4c5f-bd3b-c6f7e2d3e766 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:50.866135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c911-423b-4c5f-bd3b-c6f7e2d3e766 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:50.867495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:50.874253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7d549-76b6-4c06-88b8-061980b01b0c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:50.875042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7d549-76b6-4c06-88b8-061980b01b0c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:50.875223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7d549-76b6-4c06-88b8-061980b01b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:50.901517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-93e7d549-76b6-4c06-88b8-061980b01b0c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:50.902722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-93e7d549-76b6-4c06-88b8-061980b01b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:50.911754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:50.950409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2c911-423b-4c5f-bd3b-c6f7e2d3e766 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:50.962205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2c911-423b-4c5f-bd3b-c6f7e2d3e766 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:50.966437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b588-6859-4a11-b73a-fa6ffaf2bef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:50.967064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b588-6859-4a11-b73a-fa6ffaf2bef3 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:50.967342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b588-6859-4a11-b73a-fa6ffaf2bef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:50.967611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b588-6859-4a11-b73a-fa6ffaf2bef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:50.977335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b588-6859-4a11-b73a-fa6ffaf2bef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:50.978779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b588-6859-4a11-b73a-fa6ffaf2bef3 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:50.988127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 724/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:51:53.201647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87937f57-9ea0-452b-ae7b-84e59fb7e9ea None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:53.202212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87937f57-9ea0-452b-ae7b-84e59fb7e9ea None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:53.202212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87937f57-9ea0-452b-ae7b-84e59fb7e9ea None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:53.204333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:51:53.212163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d27b1-7a80-41d0-a8a7-fba89c7fa6ca None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:53.212563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d27b1-7a80-41d0-a8a7-fba89c7fa6ca None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:53.212774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d27b1-7a80-41d0-a8a7-fba89c7fa6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:53.232209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c93d27b1-7a80-41d0-a8a7-fba89c7fa6ca None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:51:53.233457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c93d27b1-7a80-41d0-a8a7-fba89c7fa6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:51:53.242852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:51:53.279906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87937f57-9ea0-452b-ae7b-84e59fb7e9ea None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:51:53.294950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87937f57-9ea0-452b-ae7b-84e59fb7e9ea None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:51:53.299030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b189fa-6a53-4fa6-a476-3e04d58ebe1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:51:53.299670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b189fa-6a53-4fa6-a476-3e04d58ebe1b service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:51:53.299951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b189fa-6a53-4fa6-a476-3e04d58ebe1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:51:53.300229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b189fa-6a53-4fa6-a476-3e04d58ebe1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:51:53.309149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b189fa-6a53-4fa6-a476-3e04d58ebe1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:51:53.310579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b189fa-6a53-4fa6-a476-3e04d58ebe1b service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:51:53.319728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 745/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:52:26.285550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839aa30-b0a6-4afb-9dce-3ddfd23e8b17 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:26.286194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839aa30-b0a6-4afb-9dce-3ddfd23e8b17 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:26.286194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839aa30-b0a6-4afb-9dce-3ddfd23e8b17 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:26.287551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 726/1471] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:52:26.293832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6dfd-ffad-4b4b-b2c2-3913357330af None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:26.294563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6dfd-ffad-4b4b-b2c2-3913357330af None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:26.294698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6dfd-ffad-4b4b-b2c2-3913357330af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:26.322779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-28bf6dfd-ffad-4b4b-b2c2-3913357330af None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:26.323934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-28bf6dfd-ffad-4b4b-b2c2-3913357330af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:26.332994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 746/1472] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:52:26.379114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb7ab-29f9-449d-a093-742cc8188c02 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:26.379743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb7ab-29f9-449d-a093-742cc8188c02 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:26.380030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb7ab-29f9-449d-a093-742cc8188c02 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:26.381559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 727/1473] 10.222.0.52 () {54 vars in 962 bytes} [Tue May 10 18:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:52:26.386349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2df26-5475-4261-938b-cc0cb25d7589 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:26.386643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2df26-5475-4261-938b-cc0cb25d7589 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:26.386923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2df26-5475-4261-938b-cc0cb25d7589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:26.406005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2ee2df26-5475-4261-938b-cc0cb25d7589 None None] MFA Rules not processed for user `8650bbea186e427fac890eabe18ba153`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:26.407194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2ee2df26-5475-4261-938b-cc0cb25d7589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:26.414470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 747/1474] 10.222.0.52 () {58 vars in 1059 bytes} [Tue May 10 18:52:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:52:26.422063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cb7ab-29f9-449d-a093-742cc8188c02 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:52:26.432850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cb7ab-29f9-449d-a093-742cc8188c02 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:52:26.436424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ecfc-fbb1-48a8-9c36-7896d4765e74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:52:26.437076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ecfc-fbb1-48a8-9c36-7896d4765e74 service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:26.437352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ecfc-fbb1-48a8-9c36-7896d4765e74 service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:26.437621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ecfc-fbb1-48a8-9c36-7896d4765e74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:26.446419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52ecfc-fbb1-48a8-9c36-7896d4765e74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:52:26.447838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52ecfc-fbb1-48a8-9c36-7896d4765e74 service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:52:26.457040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 728/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:52:28.779214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782d919-aba3-4870-8fee-5c93a324a1c9 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:28.779645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782d919-aba3-4870-8fee-5c93a324a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:28.779814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782d919-aba3-4870-8fee-5c93a324a1c9 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:28.782036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 748/1476] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:52:28.789962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879119ae-4686-4d96-b036-afe95b7ba3d2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:28.790415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879119ae-4686-4d96-b036-afe95b7ba3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:28.790528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879119ae-4686-4d96-b036-afe95b7ba3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:28.808307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-879119ae-4686-4d96-b036-afe95b7ba3d2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:28.809515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-879119ae-4686-4d96-b036-afe95b7ba3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:28.817642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 729/1477] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:52:28.840717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782d919-aba3-4870-8fee-5c93a324a1c9 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:52:28.854149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782d919-aba3-4870-8fee-5c93a324a1c9 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:52:28.858858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ba639-7b15-4c21-915c-58dc29c84de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:52:28.859512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ba639-7b15-4c21-915c-58dc29c84de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:28.859794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ba639-7b15-4c21-915c-58dc29c84de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:28.860070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ba639-7b15-4c21-915c-58dc29c84de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:28.860846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ba639-7b15-4c21-915c-58dc29c84de2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:52:28.862625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-a41ba639-7b15-4c21-915c-58dc29c84de2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:52:28.862625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:52:28.862625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:52:28.863761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ba639-7b15-4c21-915c-58dc29c84de2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:52:28.883070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 749/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Tue May 10 18:52:28 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:52:31.130353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461593-388c-4754-bbbb-9672872eb9c1 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:31.130910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461593-388c-4754-bbbb-9672872eb9c1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:31.130910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461593-388c-4754-bbbb-9672872eb9c1 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:31.132417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 730/1479] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:52:31.137951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a555a-87fd-4f8d-ad7f-078d41d5d7b3 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:31.138398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a555a-87fd-4f8d-ad7f-078d41d5d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:31.138495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a555a-87fd-4f8d-ad7f-078d41d5d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:31.157615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e07a555a-87fd-4f8d-ad7f-078d41d5d7b3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:31.158813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e07a555a-87fd-4f8d-ad7f-078d41d5d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:31.167310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 750/1480] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:52:31.216347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461593-388c-4754-bbbb-9672872eb9c1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:52:31.231260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461593-388c-4754-bbbb-9672872eb9c1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:52:31.237227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e35db-e9c6-4cdc-8810-6854c272e8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:52:31.237870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e35db-e9c6-4cdc-8810-6854c272e8ca service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:31.238154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e35db-e9c6-4cdc-8810-6854c272e8ca service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:31.238430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e35db-e9c6-4cdc-8810-6854c272e8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:31.246491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e35db-e9c6-4cdc-8810-6854c272e8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:52:31.248073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e35db-e9c6-4cdc-8810-6854c272e8ca service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:52:31.257777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 731/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:52:33.637495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2620e3-e7dd-4da7-ab4b-8d5d99c28fe9 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:33.638010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2620e3-e7dd-4da7-ab4b-8d5d99c28fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:33.638125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2620e3-e7dd-4da7-ab4b-8d5d99c28fe9 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:33.639717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 751/1482] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:52:33.645511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9d89-fde8-4afa-b73a-9eb30dbdfcae None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:33.645998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9d89-fde8-4afa-b73a-9eb30dbdfcae None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:33.646105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9d89-fde8-4afa-b73a-9eb30dbdfcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:33.665630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4fde9d89-fde8-4afa-b73a-9eb30dbdfcae None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:33.666837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4fde9d89-fde8-4afa-b73a-9eb30dbdfcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:33.676502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 732/1483] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:52:33.714085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2620e3-e7dd-4da7-ab4b-8d5d99c28fe9 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:52:33.726750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2620e3-e7dd-4da7-ab4b-8d5d99c28fe9 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:52:33.731303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ac25f-76d8-4d99-b01d-642d2c013ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:52:33.731979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ac25f-76d8-4d99-b01d-642d2c013ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:33.732266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ac25f-76d8-4d99-b01d-642d2c013ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:33.732548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ac25f-76d8-4d99-b01d-642d2c013ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:33.742840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ac25f-76d8-4d99-b01d-642d2c013ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:52:33.744290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ac25f-76d8-4d99-b01d-642d2c013ca2 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:52:33.753978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 752/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:52:36.029020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037ffc-87b3-475e-a477-89031da1d209 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:36.029920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037ffc-87b3-475e-a477-89031da1d209 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:36.029920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037ffc-87b3-475e-a477-89031da1d209 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:36.032200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 733/1485] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:52:36.037800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788489-48d9-43d7-853c-fcce90f3b3be None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:36.038261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788489-48d9-43d7-853c-fcce90f3b3be None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:36.038369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788489-48d9-43d7-853c-fcce90f3b3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:36.056313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-18788489-48d9-43d7-853c-fcce90f3b3be None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:36.057534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-18788489-48d9-43d7-853c-fcce90f3b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:36.066124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 753/1486] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:52:36.103710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79037ffc-87b3-475e-a477-89031da1d209 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:52:36.122041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79037ffc-87b3-475e-a477-89031da1d209 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:52:36.128979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df2d1-d0da-4e4e-aa0a-bd53d737789a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:52:36.130294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df2d1-d0da-4e4e-aa0a-bd53d737789a service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:36.130629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df2d1-d0da-4e4e-aa0a-bd53d737789a service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:36.131121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df2d1-d0da-4e4e-aa0a-bd53d737789a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:36.140457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df2d1-d0da-4e4e-aa0a-bd53d737789a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:52:36.141946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df2d1-d0da-4e4e-aa0a-bd53d737789a service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:52:36.151435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 734/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:52:38.514222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb762-9e97-443f-84d8-5a4cf6d173fc None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:38.514840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb762-9e97-443f-84d8-5a4cf6d173fc None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:38.514840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb762-9e97-443f-84d8-5a4cf6d173fc None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:38.516181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 754/1488] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:52:38.522098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5b94-7c8e-4bb8-9eaf-4418b1efc071 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:38.522550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5b94-7c8e-4bb8-9eaf-4418b1efc071 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:38.522647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5b94-7c8e-4bb8-9eaf-4418b1efc071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:38.540508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9c5e5b94-7c8e-4bb8-9eaf-4418b1efc071 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:38.541730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9c5e5b94-7c8e-4bb8-9eaf-4418b1efc071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:38.550087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 735/1489] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:52:38.590776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abb762-9e97-443f-84d8-5a4cf6d173fc None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:52:38.607595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abb762-9e97-443f-84d8-5a4cf6d173fc None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:52:38.612018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b477-79f4-47b6-b82c-7d24e55f6004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:52:38.612667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b477-79f4-47b6-b82c-7d24e55f6004 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:38.612981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b477-79f4-47b6-b82c-7d24e55f6004 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:38.613258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b477-79f4-47b6-b82c-7d24e55f6004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:38.623209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852b477-79f4-47b6-b82c-7d24e55f6004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:52:38.624645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852b477-79f4-47b6-b82c-7d24e55f6004 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:52:38.635064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 755/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:52:41.131792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f8d8-f76e-45f5-84ea-225b232a4942 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:41.132422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f8d8-f76e-45f5-84ea-225b232a4942 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:41.132422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f8d8-f76e-45f5-84ea-225b232a4942 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:41.134520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 736/1491] 10.222.0.52 () {54 vars in 926 bytes} [Tue May 10 18:52:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:52:41.143404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902dac8-bfb9-488b-8fa5-d9d98659425d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:41.143813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902dac8-bfb9-488b-8fa5-d9d98659425d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:41.144028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902dac8-bfb9-488b-8fa5-d9d98659425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:41.171936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0902dac8-bfb9-488b-8fa5-d9d98659425d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:52:41.173201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0902dac8-bfb9-488b-8fa5-d9d98659425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:52:41.182833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 756/1492] 10.222.0.52 () {58 vars in 1023 bytes} [Tue May 10 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:52:41.223861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f8d8-f76e-45f5-84ea-225b232a4942 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:52:41.238733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f8d8-f76e-45f5-84ea-225b232a4942 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:52:41.244524 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf22bd-5983-4b51-ad6b-e0b45abba286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:52:41.245204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf22bd-5983-4b51-ad6b-e0b45abba286 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:52:41.245488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf22bd-5983-4b51-ad6b-e0b45abba286 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:52:41.245761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf22bd-5983-4b51-ad6b-e0b45abba286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:52:41.256352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf22bd-5983-4b51-ad6b-e0b45abba286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:52:41.257837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf22bd-5983-4b51-ad6b-e0b45abba286 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:52:41.267701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 737/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:54:15.284409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d98f7b-abca-40c6-97c5-97eb15486c0a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.285403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d98f7b-abca-40c6-97c5-97eb15486c0a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.285403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d98f7b-abca-40c6-97c5-97eb15486c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.311784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-03d98f7b-abca-40c6-97c5-97eb15486c0a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:54:15.313024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-03d98f7b-abca-40c6-97c5-97eb15486c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:54:15.322024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 757/1494] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:54:15.336037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e124853-406c-4181-8676-5d988e4d5825 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.336852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e124853-406c-4181-8676-5d988e4d5825 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.336852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e124853-406c-4181-8676-5d988e4d5825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.369625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4e124853-406c-4181-8676-5d988e4d5825 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:54:15.371321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4e124853-406c-4181-8676-5d988e4d5825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:54:15.386401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 738/1495] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:54:15.391215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d98f7b-abca-40c6-97c5-97eb15486c0a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:15.401381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d98f7b-abca-40c6-97c5-97eb15486c0a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:15.407201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:15.407898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.408171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.408438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.409205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:54:15.409509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:15.410529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:15.410529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:54:15.410529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:54:15.411388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:15.423848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 758/1496] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:54:15.432346 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e124853-406c-4181-8676-5d988e4d5825 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:15.442105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e124853-406c-4181-8676-5d988e4d5825 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:15.448088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:15.448809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.449065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.449338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.450031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:15.451865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING py.warnings [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:15.451865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: warnings.warn(msg) May 10 18:54:15.451865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: May 10 18:54:15.453469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:15.492165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 739/1497] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:54:15 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:54:15.496529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:15.507610 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b7bf-1fb3-419f-b513-fa5a65292d81 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:15.565202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:15.565202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.565202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.565202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.567308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:15.567308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:15.567308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:54:15.567308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:54:15.568093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:15.591253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 759/1498] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:54:15 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:54:15.595598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:15.606753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24052ea7-ec50-4937-8d7d-bd766c0ffdc6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:15.612317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:15.613534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.613849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.614176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.615061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:15.616644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING py.warnings [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:15.616644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: warnings.warn(msg) May 10 18:54:15.616644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: May 10 18:54:15.618040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:15.638362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 740/1499] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:54:15.644647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:15.660447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f1bdc-42c9-4f8c-af6b-ab4d5120b907 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:15.668489 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e821a-9974-44eb-b54e-0dd179431a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:15.669206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e821a-9974-44eb-b54e-0dd179431a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.669465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e821a-9974-44eb-b54e-0dd179431a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.669746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e821a-9974-44eb-b54e-0dd179431a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.670480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e821a-9974-44eb-b54e-0dd179431a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:15.671492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-5c7e821a-9974-44eb-b54e-0dd179431a07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:15.671492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:54:15.671492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:54:15.672367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e821a-9974-44eb-b54e-0dd179431a07 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:15.692696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 760/1500] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:54:15.697120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:15.707586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beea1c-2615-4730-8bd4-b513db426401 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:15.713672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b2b69-70c2-4ba4-870c-67fbdfe891eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:15.714573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2b69-70c2-4ba4-870c-67fbdfe891eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.714851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2b69-70c2-4ba4-870c-67fbdfe891eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.715099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2b69-70c2-4ba4-870c-67fbdfe891eb admin admin] PATH_INFO: `/v3/projects/5fae609d0c5849c49266341fd1b00b05/users/31ae7ac073db47fd8c3687a64baa9835/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.731325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b2b69-70c2-4ba4-870c-67fbdfe891eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fae609d0c5849c49266341fd1b00b05, user_id=31ae7ac073db47fd8c3687a64baa9835, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:15.732418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING py.warnings [None req-3b3b2b69-70c2-4ba4-870c-67fbdfe891eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:15.732418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: warnings.warn(msg) May 10 18:54:15.732418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: May 10 18:54:15.734412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b2b69-70c2-4ba4-870c-67fbdfe891eb admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:15.754126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 741/1501] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:54:15 2022] PUT /identity/v3/projects/5fae609d0c5849c49266341fd1b00b05/users/31ae7ac073db47fd8c3687a64baa9835/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:54:15.766347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a8b57-83a9-4474-b826-72c1be922670 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.766636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a8b57-83a9-4474-b826-72c1be922670 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.766941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a8b57-83a9-4474-b826-72c1be922670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.794584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-674a8b57-83a9-4474-b826-72c1be922670 None None] MFA Rules not processed for user `31ae7ac073db47fd8c3687a64baa9835`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:54:15.795821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-674a8b57-83a9-4474-b826-72c1be922670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:54:15.871390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 761/1502] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:54:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:54:15.886442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853878bb-a994-4e2c-8820-9bbcb6dbfe56 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.886830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853878bb-a994-4e2c-8820-9bbcb6dbfe56 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.887074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853878bb-a994-4e2c-8820-9bbcb6dbfe56 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.889161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 742/1503] 10.222.0.52 () {54 vars in 963 bytes} [Tue May 10 18:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:54:15.894914 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4dfe3-6763-4b45-9d5d-8cd6b05ba9be None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:15.895213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4dfe3-6763-4b45-9d5d-8cd6b05ba9be None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:15.895479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4dfe3-6763-4b45-9d5d-8cd6b05ba9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:15.915179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b6f4dfe3-6763-4b45-9d5d-8cd6b05ba9be None None] MFA Rules not processed for user `b8cb476654be463e9d7d19d92576e495`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:54:15.916369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b6f4dfe3-6763-4b45-9d5d-8cd6b05ba9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:54:15.972970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 762/1504] 10.222.0.52 () {58 vars in 1060 bytes} [Tue May 10 18:54:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:54:15.984573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853878bb-a994-4e2c-8820-9bbcb6dbfe56 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:15.997025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853878bb-a994-4e2c-8820-9bbcb6dbfe56 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:16.001673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:16.002342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:16.002621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:16.002864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:16.012427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:16.014764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:16.028321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 743/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:54:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:54:16.070859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c468-9558-47cb-a96b-0d3512ee6af1 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:16.071147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c468-9558-47cb-a96b-0d3512ee6af1 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:16.071422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c468-9558-47cb-a96b-0d3512ee6af1 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:16.072853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 763/1506] 10.222.0.52 () {52 vars in 829 bytes} [Tue May 10 18:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:54:16.077034 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:16.139211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a91e5-6904-405e-8887-45f025313deb service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:16.147459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:16.148812 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:16.149152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:16.149484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] PATH_INFO: `/v3/users/31ae7ac073db47fd8c3687a64baa9835` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:16.151410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ae7ac073db47fd8c3687a64baa9835)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:16.153035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING py.warnings [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:16.153035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: warnings.warn(msg) May 10 18:54:16.153035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: May 10 18:54:16.154809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:16.225731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ae7ac073db47fd8c3687a64baa9835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.226392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ae7ac073db47fd8c3687a64baa9835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.244897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ae7ac073db47fd8c3687a64baa9835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.254859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ae7ac073db47fd8c3687a64baa9835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.267771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ae7ac073db47fd8c3687a64baa9835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.274126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 744/1507] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:54:16 2022] DELETE /identity/v3/users/31ae7ac073db47fd8c3687a64baa9835 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:54:16.278920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:16.279202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:16.279479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:16.298844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:54:16.300041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:54:16.362991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 764/1508] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:54:16.374410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:16.376264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:54:16.439011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890e96-022f-4bcc-abef-da1333e15bfa admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:16.443196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8954-3360-4370-a67e-ba6fa653f313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:16.443858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8954-3360-4370-a67e-ba6fa653f313 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:16.444141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8954-3360-4370-a67e-ba6fa653f313 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:16.444414 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8954-3360-4370-a67e-ba6fa653f313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:16.453773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8954-3360-4370-a67e-ba6fa653f313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:16.455223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8954-3360-4370-a67e-ba6fa653f313 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:16.464723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 745/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:54:16.803928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:54:16.805471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:54:16.817549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef0f29-0881-466f-9111-457756d13a34 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:54:16.823615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:54:16.824550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:54:16.825633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:54:16.825928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] PATH_INFO: `/v3/projects/5fae609d0c5849c49266341fd1b00b05` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:54:16.827353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fae609d0c5849c49266341fd1b00b05)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:54:16.828561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:54:16.828561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:54:16.828561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:54:16.830548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:54:16.891563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fae609d0c5849c49266341fd1b00b05', 'request_id': 'req-b43b5bee-e162-4137-abff-5a29ff684e20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.902494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fae609d0c5849c49266341fd1b00b05', 'request_id': 'req-b43b5bee-e162-4137-abff-5a29ff684e20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.917818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fae609d0c5849c49266341fd1b00b05', 'request_id': 'req-b43b5bee-e162-4137-abff-5a29ff684e20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.929827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] The token cache is being invalidate because project 5fae609d0c5849c49266341fd1b00b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:54:16.930113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.930981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b43b5bee-e162-4137-abff-5a29ff684e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:54:16.932642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 765/1510] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:54:16 2022] DELETE /identity/v3/projects/5fae609d0c5849c49266341fd1b00b05 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:56:01.627019 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5a7da-0436-4e2b-abac-869c105d36c4 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:01.627978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5a7da-0436-4e2b-abac-869c105d36c4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:01.627978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5a7da-0436-4e2b-abac-869c105d36c4 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:01.630724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:56:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:01.636422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e43ba-62bc-4e3f-88f2-31c239b36ca2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:01.636931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e43ba-62bc-4e3f-88f2-31c239b36ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:01.637039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e43ba-62bc-4e3f-88f2-31c239b36ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:01.656170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1f9e43ba-62bc-4e3f-88f2-31c239b36ca2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:01.657443 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1f9e43ba-62bc-4e3f-88f2-31c239b36ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:01.720213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:01.895619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5a7da-0436-4e2b-abac-869c105d36c4 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:01.898577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d0a5a7da-0436-4e2b-abac-869c105d36c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:01.976273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5a7da-0436-4e2b-abac-869c105d36c4 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:01.982744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecc6ba-21ee-4dc3-bd86-3bea85971e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:01.983395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecc6ba-21ee-4dc3-bd86-3bea85971e1b service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:01.983680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecc6ba-21ee-4dc3-bd86-3bea85971e1b service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:01.983958 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecc6ba-21ee-4dc3-bd86-3bea85971e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:01.992360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecc6ba-21ee-4dc3-bd86-3bea85971e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:01.994001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecc6ba-21ee-4dc3-bd86-3bea85971e1b service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:02.003441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 747/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:02.554593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b7d49-7d4b-43cb-b2d9-1e1ae8efaf01 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:02.554883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b7d49-7d4b-43cb-b2d9-1e1ae8efaf01 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:02.555130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b7d49-7d4b-43cb-b2d9-1e1ae8efaf01 None None] PATH_INFO: `/v3` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:02.556650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 767/1514] 10.222.0.48 () {54 vars in 925 bytes} [Tue May 10 18:56:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:56:02.563902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90c9a5-e866-4094-a212-4efc69676a31 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:02.564196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90c9a5-e866-4094-a212-4efc69676a31 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:02.564474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90c9a5-e866-4094-a212-4efc69676a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:02.583777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-bd90c9a5-e866-4094-a212-4efc69676a31 None None] MFA Rules not processed for user `698df68d01c641c1b4455509d798d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:02.585091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-bd90c9a5-e866-4094-a212-4efc69676a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:02.648218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 748/1515] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 10 18:56:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:02.919137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae54fbd-8894-4605-b078-ab617fe104d2 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:02.920116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae54fbd-8894-4605-b078-ab617fe104d2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:02.920116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae54fbd-8894-4605-b078-ab617fe104d2 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:02.922484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 768/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:56:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:02.928634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a49eb-8363-40f2-a92f-f4a98e684ba4 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:02.929045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a49eb-8363-40f2-a92f-f4a98e684ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:02.929452 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a49eb-8363-40f2-a92f-f4a98e684ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:02.957794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-663a49eb-8363-40f2-a92f-f4a98e684ba4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:02.959020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-663a49eb-8363-40f2-a92f-f4a98e684ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:02.968804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 749/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:03.124335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae54fbd-8894-4605-b078-ab617fe104d2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:03.141653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae54fbd-8894-4605-b078-ab617fe104d2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:03.147881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773a35-6c15-4288-a0be-4d4fc41001c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:03.148530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773a35-6c15-4288-a0be-4d4fc41001c5 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:03.148841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773a35-6c15-4288-a0be-4d4fc41001c5 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:03.149123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773a35-6c15-4288-a0be-4d4fc41001c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:03.158001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773a35-6c15-4288-a0be-4d4fc41001c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:03.159611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773a35-6c15-4288-a0be-4d4fc41001c5 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:03.169329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 769/1518] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:11.816108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef819e-cd49-4edd-8632-cd47d7847d53 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:11.817109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef819e-cd49-4edd-8632-cd47d7847d53 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:11.817109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef819e-cd49-4edd-8632-cd47d7847d53 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:11.819383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 750/1519] 10.222.0.52 () {54 vars in 960 bytes} [Tue May 10 18:56:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:11.826935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531015c-2a4a-46b3-ab70-5c9ea82c2bf8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:11.827451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531015c-2a4a-46b3-ab70-5c9ea82c2bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:11.827558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531015c-2a4a-46b3-ab70-5c9ea82c2bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:11.846843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7531015c-2a4a-46b3-ab70-5c9ea82c2bf8 None None] MFA Rules not processed for user `698df68d01c641c1b4455509d798d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:11.848027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7531015c-2a4a-46b3-ab70-5c9ea82c2bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:11.858185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 770/1520] 10.222.0.52 () {58 vars in 1057 bytes} [Tue May 10 18:56:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:11.866095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef819e-cd49-4edd-8632-cd47d7847d53 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:11.886537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef819e-cd49-4edd-8632-cd47d7847d53 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:11.893291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09776-9a45-4603-b970-7a3beae5d226 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:11.893980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09776-9a45-4603-b970-7a3beae5d226 service placement] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:11.894253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09776-9a45-4603-b970-7a3beae5d226 service placement] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:11.894523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09776-9a45-4603-b970-7a3beae5d226 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:11.904027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09776-9a45-4603-b970-7a3beae5d226 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:11.905682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09776-9a45-4603-b970-7a3beae5d226 service placement] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:11.916152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 751/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:14.502580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504a5f-9ba8-4378-a587-4920b73772b0 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:14.503413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504a5f-9ba8-4378-a587-4920b73772b0 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:14.503413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504a5f-9ba8-4378-a587-4920b73772b0 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:14.506074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:56:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:14.511135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf75c0-2652-4664-8fbc-8d8b8df72f43 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:14.511615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf75c0-2652-4664-8fbc-8d8b8df72f43 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:14.511737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf75c0-2652-4664-8fbc-8d8b8df72f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:14.531570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-44bf75c0-2652-4664-8fbc-8d8b8df72f43 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:14.532783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-44bf75c0-2652-4664-8fbc-8d8b8df72f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:14.541215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:14.697278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504a5f-9ba8-4378-a587-4920b73772b0 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:14.714846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504a5f-9ba8-4378-a587-4920b73772b0 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:14.721028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583d13a-92a7-4b5e-aa9d-ea962258583d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:14.721666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583d13a-92a7-4b5e-aa9d-ea962258583d service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:14.721949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583d13a-92a7-4b5e-aa9d-ea962258583d service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:14.722224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583d13a-92a7-4b5e-aa9d-ea962258583d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:14.730501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583d13a-92a7-4b5e-aa9d-ea962258583d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:14.732100 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583d13a-92a7-4b5e-aa9d-ea962258583d service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:14.741462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 772/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:15.626129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9fe06-8d5f-464c-b113-8405b03a0cee None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:15.626773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9fe06-8d5f-464c-b113-8405b03a0cee None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:15.626773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9fe06-8d5f-464c-b113-8405b03a0cee None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:15.628052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 18:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:15.634663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b62b-19d9-475b-8004-98d7a6309074 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:15.635366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b62b-19d9-475b-8004-98d7a6309074 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:15.635562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b62b-19d9-475b-8004-98d7a6309074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:15.655583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0aa7b62b-19d9-475b-8004-98d7a6309074 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:15.656823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0aa7b62b-19d9-475b-8004-98d7a6309074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:15.665693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 18:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:15.824370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9fe06-8d5f-464c-b113-8405b03a0cee None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:15.841084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9fe06-8d5f-464c-b113-8405b03a0cee None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:15.847541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dd12c-a23e-4a56-bf89-7e667755243d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:15.848173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd12c-a23e-4a56-bf89-7e667755243d service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:15.848451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd12c-a23e-4a56-bf89-7e667755243d service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:15.848722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd12c-a23e-4a56-bf89-7e667755243d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:15.857334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dd12c-a23e-4a56-bf89-7e667755243d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:15.858991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dd12c-a23e-4a56-bf89-7e667755243d service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:15.868190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 754/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:20.391184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f60e-75ec-4441-8fa3-b4f8a5be51c8 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:20.391781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f60e-75ec-4441-8fa3-b4f8a5be51c8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:20.391781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f60e-75ec-4441-8fa3-b4f8a5be51c8 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:20.393913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:56:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:20.402626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc9081-124f-45a5-8a93-3e6c9f8d40e3 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:20.403067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc9081-124f-45a5-8a93-3e6c9f8d40e3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:20.403199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc9081-124f-45a5-8a93-3e6c9f8d40e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:20.423087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-aafc9081-124f-45a5-8a93-3e6c9f8d40e3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:20.425420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-aafc9081-124f-45a5-8a93-3e6c9f8d40e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:20.434437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:20.471090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f60e-75ec-4441-8fa3-b4f8a5be51c8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:20.473713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8e15f60e-75ec-4441-8fa3-b4f8a5be51c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:20.537495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f60e-75ec-4441-8fa3-b4f8a5be51c8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:20.541888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98491276-86d7-4ef0-911f-c3cd11471f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:20.542550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491276-86d7-4ef0-911f-c3cd11471f79 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:20.542834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491276-86d7-4ef0-911f-c3cd11471f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:20.543109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491276-86d7-4ef0-911f-c3cd11471f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:20.552624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98491276-86d7-4ef0-911f-c3cd11471f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:20.554097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98491276-86d7-4ef0-911f-c3cd11471f79 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:20.563564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 775/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:22.766022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718a404-3818-4c85-9ef3-46027bdd67bf None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:22.766879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718a404-3818-4c85-9ef3-46027bdd67bf None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:22.766879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718a404-3818-4c85-9ef3-46027bdd67bf None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:22.769076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:56:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:22.774632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fefdec-4fe9-44c3-8d66-086704e6048b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:22.775082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fefdec-4fe9-44c3-8d66-086704e6048b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:22.775181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fefdec-4fe9-44c3-8d66-086704e6048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:22.793992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-11fefdec-4fe9-44c3-8d66-086704e6048b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:22.795216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-11fefdec-4fe9-44c3-8d66-086704e6048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:22.803667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:22.838682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718a404-3818-4c85-9ef3-46027bdd67bf None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:22.850407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718a404-3818-4c85-9ef3-46027bdd67bf None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:22.854090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac9950-0720-4a90-9b9b-6e5762933126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:22.854722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9950-0720-4a90-9b9b-6e5762933126 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:22.854997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9950-0720-4a90-9b9b-6e5762933126 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:22.855242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9950-0720-4a90-9b9b-6e5762933126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:22.863936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac9950-0720-4a90-9b9b-6e5762933126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:22.865397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac9950-0720-4a90-9b9b-6e5762933126 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:22.874499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 757/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:26.783311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba95792-7eb0-48bb-8bf8-61f46d46b63b None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:26.784116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba95792-7eb0-48bb-8bf8-61f46d46b63b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:26.784116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba95792-7eb0-48bb-8bf8-61f46d46b63b None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:26.786233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:56:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:26.795022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8993b91-9c1a-4603-80ce-5f2db4add37d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:26.795476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8993b91-9c1a-4603-80ce-5f2db4add37d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:26.795581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8993b91-9c1a-4603-80ce-5f2db4add37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:26.814776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a8993b91-9c1a-4603-80ce-5f2db4add37d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:26.815988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a8993b91-9c1a-4603-80ce-5f2db4add37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:26.833765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:27.110198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba95792-7eb0-48bb-8bf8-61f46d46b63b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:27.113265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1ba95792-7eb0-48bb-8bf8-61f46d46b63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:27.178368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba95792-7eb0-48bb-8bf8-61f46d46b63b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:27.182591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db4d9d-daab-4e6c-af5c-0bceb6726b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:27.183239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db4d9d-daab-4e6c-af5c-0bceb6726b15 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:27.183518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db4d9d-daab-4e6c-af5c-0bceb6726b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:27.184152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db4d9d-daab-4e6c-af5c-0bceb6726b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:27.193862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db4d9d-daab-4e6c-af5c-0bceb6726b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:27.195292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db4d9d-daab-4e6c-af5c-0bceb6726b15 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:27.204666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 778/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:56:29.460094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20026ca-5d3f-4a14-b0a7-763ab3e33f22 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:29.460560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20026ca-5d3f-4a14-b0a7-763ab3e33f22 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:29.460666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20026ca-5d3f-4a14-b0a7-763ab3e33f22 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:29.462067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 18:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:56:29.467970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1df63-4b9d-42e3-8861-e177410a412d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:29.468463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1df63-4b9d-42e3-8861-e177410a412d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:29.468564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1df63-4b9d-42e3-8861-e177410a412d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:29.487522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-54a1df63-4b9d-42e3-8861-e177410a412d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:56:29.488734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-54a1df63-4b9d-42e3-8861-e177410a412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:29.497673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:56:29.766057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20026ca-5d3f-4a14-b0a7-763ab3e33f22 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:56:29.768043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f20026ca-5d3f-4a14-b0a7-763ab3e33f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:56:29.782583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20026ca-5d3f-4a14-b0a7-763ab3e33f22 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:56:29.786794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160f392-210d-4735-b71f-f9454a411405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:56:29.787649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160f392-210d-4735-b71f-f9454a411405 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:56:29.787967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160f392-210d-4735-b71f-f9454a411405 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:56:29.788343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160f392-210d-4735-b71f-f9454a411405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:56:29.800779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160f392-210d-4735-b71f-f9454a411405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:56:29.802229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160f392-210d-4735-b71f-f9454a411405 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:56:29.811890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 760/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:01.742011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363503-5dc5-45bc-9e8c-16991c18bbe5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:01.743020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363503-5dc5-45bc-9e8c-16991c18bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:01.743469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363503-5dc5-45bc-9e8c-16991c18bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:01.778543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-dc363503-5dc5-45bc-9e8c-16991c18bbe5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:01.780029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-dc363503-5dc5-45bc-9e8c-16991c18bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:01.793422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 780/1540] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:01.805672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99762a88-fc2b-4571-b605-b92ab1038ed8 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:01.806286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99762a88-fc2b-4571-b605-b92ab1038ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:01.806286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99762a88-fc2b-4571-b605-b92ab1038ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:01.829454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-99762a88-fc2b-4571-b605-b92ab1038ed8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:01.831010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-99762a88-fc2b-4571-b605-b92ab1038ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:01.842147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 761/1541] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:01.847318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc363503-5dc5-45bc-9e8c-16991c18bbe5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:01.858636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc363503-5dc5-45bc-9e8c-16991c18bbe5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:01.866167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:01.866859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:01.867143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:01.867422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:01.868170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:01.868478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:01.870128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:01.887374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 781/1542] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:01.893968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99762a88-fc2b-4571-b605-b92ab1038ed8 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:01.903489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99762a88-fc2b-4571-b605-b92ab1038ed8 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:01.914022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fb81a-2858-48fc-88cf-2c4d52fae582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:01.914923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fb81a-2858-48fc-88cf-2c4d52fae582 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:01.915355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fb81a-2858-48fc-88cf-2c4d52fae582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:01.915774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fb81a-2858-48fc-88cf-2c4d52fae582 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:01.916643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fb81a-2858-48fc-88cf-2c4d52fae582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:01.918764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fb81a-2858-48fc-88cf-2c4d52fae582 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:01.978085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 762/1543] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:01 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:58:01.981816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:01.992865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfcdd2-d1b1-4972-903b-c8faa10c4b89 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.070362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.071080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.071364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.072524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.073372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.075396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.083568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3908833-6cd6-416a-96bd-a4635d4b3204 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.084146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3908833-6cd6-416a-96bd-a4635d4b3204 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.084584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3908833-6cd6-416a-96bd-a4635d4b3204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.122133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c3908833-6cd6-416a-96bd-a4635d4b3204 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.126205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 782/1544] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:01 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:02.129566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c3908833-6cd6-416a-96bd-a4635d4b3204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.131070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.143358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 763/1545] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.151285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b738f-4a53-45ac-b4c3-998d8ac78426 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.153932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0306-396a-49eb-9d73-aa19f9ec13d1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.154405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0306-396a-49eb-9d73-aa19f9ec13d1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.154850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0306-396a-49eb-9d73-aa19f9ec13d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.160708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.161409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.161692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.161970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.162728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.165228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.183922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 783/1546] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:02.186879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8d8a0306-396a-49eb-9d73-aa19f9ec13d1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.189095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8d8a0306-396a-49eb-9d73-aa19f9ec13d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.194201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.203981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 764/1547] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.208779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a0306-396a-49eb-9d73-aa19f9ec13d1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.211224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7303-969a-4916-a47a-fef12215ead7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.218996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.220323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.220824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.221276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.222312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.222885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a0306-396a-49eb-9d73-aa19f9ec13d1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.224591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.244412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 784/1548] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:02.245221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.245584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.245873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.246156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.247051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:02.247365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.248410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING py.warnings [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 18:58:02.248410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: warnings.warn(msg) May 10 18:58:02.248410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: May 10 18:58:02.249498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.265145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.267038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 765/1549] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:02.275238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.283656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad1927-8a6e-4e97-a40c-eb7c88a78b13 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.286733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1addceb-b5f2-4de0-b062-cae13505fd76 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.290844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7cabb-5027-4156-9d19-0b4d3f3eb4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.292291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7cabb-5027-4156-9d19-0b4d3f3eb4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.292756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7cabb-5027-4156-9d19-0b4d3f3eb4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.293278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7cabb-5027-4156-9d19-0b4d3f3eb4e9 admin admin] PATH_INFO: `/v3/projects/772abdeeb78b4eaab9bc9d831eda68f3/users/9d4785218d704599b5e3481ca05a4b8a/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.309255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.309959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.312125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.312125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.312125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.313623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.331130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7cabb-5027-4156-9d19-0b4d3f3eb4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772abdeeb78b4eaab9bc9d831eda68f3, user_id=9d4785218d704599b5e3481ca05a4b8a, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.332580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-77d7cabb-5027-4156-9d19-0b4d3f3eb4e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:58:02.332580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:58:02.332580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:58:02.335852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7cabb-5027-4156-9d19-0b4d3f3eb4e9 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.376939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 766/1550] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:02.378573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 785/1551] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:02 2022] PUT /identity/v3/projects/772abdeeb78b4eaab9bc9d831eda68f3/users/9d4785218d704599b5e3481ca05a4b8a/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:02.381952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.398626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7e6d1-89ca-4042-a897-bc5d27b2db36 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.399282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7e6d1-89ca-4042-a897-bc5d27b2db36 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.399806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7e6d1-89ca-4042-a897-bc5d27b2db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.433270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-24c7e6d1-89ca-4042-a897-bc5d27b2db36 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.435528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-24c7e6d1-89ca-4042-a897-bc5d27b2db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.464649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc0ce5-3c5f-41ca-8829-c2f8ae9c0129 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.480947 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ff111-45ad-4b9b-bbd5-b9e5c5f04409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.482043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ff111-45ad-4b9b-bbd5-b9e5c5f04409 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.482530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ff111-45ad-4b9b-bbd5-b9e5c5f04409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.483030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ff111-45ad-4b9b-bbd5-b9e5c5f04409 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.483948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ff111-45ad-4b9b-bbd5-b9e5c5f04409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.485220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING py.warnings [None req-543ff111-45ad-4b9b-bbd5-b9e5c5f04409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:58:02.485220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: warnings.warn(msg) May 10 18:58:02.485220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: May 10 18:58:02.492004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ff111-45ad-4b9b-bbd5-b9e5c5f04409 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.515919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 767/1552] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:58:02.517956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c900e-0e58-4798-a343-7f92fe357471 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.518505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c900e-0e58-4798-a343-7f92fe357471 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.518836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c900e-0e58-4798-a343-7f92fe357471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.538924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-140c900e-0e58-4798-a343-7f92fe357471 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.540246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-140c900e-0e58-4798-a343-7f92fe357471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.545093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 786/1553] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:02.545093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558973-9c3d-4e31-822d-d57a5547ad55 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.545093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558973-9c3d-4e31-822d-d57a5547ad55 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.545093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558973-9c3d-4e31-822d-d57a5547ad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.564190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 768/1554] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.565688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886309f4-0d91-4be8-91a0-5bc13fec92d1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.565978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886309f4-0d91-4be8-91a0-5bc13fec92d1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.566255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886309f4-0d91-4be8-91a0-5bc13fec92d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.568097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e5558973-9c3d-4e31-822d-d57a5547ad55 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.569609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e5558973-9c3d-4e31-822d-d57a5547ad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.577582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 787/1555] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.579464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6075-565c-40d5-bd17-c5c075b53962 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.579752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6075-565c-40d5-bd17-c5c075b53962 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.580030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6075-565c-40d5-bd17-c5c075b53962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.589065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-886309f4-0d91-4be8-91a0-5bc13fec92d1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.590265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-886309f4-0d91-4be8-91a0-5bc13fec92d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.598400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 769/1556] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.598579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c76d6075-565c-40d5-bd17-c5c075b53962 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.599798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4179d-def1-49d2-8e12-912c0e967025 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.599921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c76d6075-565c-40d5-bd17-c5c075b53962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.600085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4179d-def1-49d2-8e12-912c0e967025 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.600359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4179d-def1-49d2-8e12-912c0e967025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.609739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 788/1557] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.610565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6075-565c-40d5-bd17-c5c075b53962 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.618484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-3db4179d-def1-49d2-8e12-912c0e967025 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.619672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3db4179d-def1-49d2-8e12-912c0e967025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.624014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6075-565c-40d5-bd17-c5c075b53962 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.628039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 770/1558] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.628969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4179d-def1-49d2-8e12-912c0e967025 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.629264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b0bd2-7431-4a21-b2c4-a19e7d1f45c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.630063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0bd2-7431-4a21-b2c4-a19e7d1f45c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.630351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0bd2-7431-4a21-b2c4-a19e7d1f45c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.630630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0bd2-7431-4a21-b2c4-a19e7d1f45c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.631365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b0bd2-7431-4a21-b2c4-a19e7d1f45c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.633003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b0bd2-7431-4a21-b2c4-a19e7d1f45c2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.643043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 789/1559] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:02.645142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025890-c042-45a8-8c11-cb6e46a1b90c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.645643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025890-c042-45a8-8c11-cb6e46a1b90c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.646108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025890-c042-45a8-8c11-cb6e46a1b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.663824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-dc025890-c042-45a8-8c11-cb6e46a1b90c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.665068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-dc025890-c042-45a8-8c11-cb6e46a1b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.673014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 790/1560] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.674353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd8fd-f5f8-440e-8841-36c224a4d3bb None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.674626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd8fd-f5f8-440e-8841-36c224a4d3bb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.675087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd8fd-f5f8-440e-8841-36c224a4d3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.691572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4179d-def1-49d2-8e12-912c0e967025 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.694566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-740bd8fd-f5f8-440e-8841-36c224a4d3bb None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.695307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c753-41c0-40ac-955e-45701c9bd8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.695763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-740bd8fd-f5f8-440e-8841-36c224a4d3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.695966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c753-41c0-40ac-955e-45701c9bd8db service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.696279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c753-41c0-40ac-955e-45701c9bd8db service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.696564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c753-41c0-40ac-955e-45701c9bd8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.703651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 791/1561] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.705704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14c753-41c0-40ac-955e-45701c9bd8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.707409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14c753-41c0-40ac-955e-45701c9bd8db service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.708532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c8d2-98e5-4fc8-bf59-2b2dfde925ff None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.708858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c8d2-98e5-4fc8-bf59-2b2dfde925ff None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.709114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c8d2-98e5-4fc8-bf59-2b2dfde925ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.716717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 771/1562] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:02.717942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962a99-2495-411b-b9ce-70d3641347af None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.718227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962a99-2495-411b-b9ce-70d3641347af None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.718502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962a99-2495-411b-b9ce-70d3641347af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.727234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4f80c8d2-98e5-4fc8-bf59-2b2dfde925ff None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.728416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4f80c8d2-98e5-4fc8-bf59-2b2dfde925ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.736551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7b962a99-2495-411b-b9ce-70d3641347af None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.737525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 792/1563] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.737856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7b962a99-2495-411b-b9ce-70d3641347af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.738848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe45a-7aeb-4154-b1bf-df35e0c51767 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.739139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe45a-7aeb-4154-b1bf-df35e0c51767 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.739412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe45a-7aeb-4154-b1bf-df35e0c51767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.746584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 772/1564] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.748336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364f306-84dc-4fee-85bf-336fda2b4d3c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.748622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364f306-84dc-4fee-85bf-336fda2b4d3c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.748946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364f306-84dc-4fee-85bf-336fda2b4d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.758701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1eebe45a-7aeb-4154-b1bf-df35e0c51767 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.759963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1eebe45a-7aeb-4154-b1bf-df35e0c51767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.767419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1364f306-84dc-4fee-85bf-336fda2b4d3c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.768191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 793/1565] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.768704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1364f306-84dc-4fee-85bf-336fda2b4d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.772453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe45a-7aeb-4154-b1bf-df35e0c51767 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.777024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 773/1566] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.778259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ffac-4513-47e4-9309-ce245dcebdce None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.778543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ffac-4513-47e4-9309-ce245dcebdce None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.778815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ffac-4513-47e4-9309-ce245dcebdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.785745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe45a-7aeb-4154-b1bf-df35e0c51767 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.791358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.792088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.792374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.792701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.793403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.795008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.797775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-6b91ffac-4513-47e4-9309-ce245dcebdce None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:02.798903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6b91ffac-4513-47e4-9309-ce245dcebdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:02.805703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 794/1567] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:02.805703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.810602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 774/1568] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:02.811366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91ffac-4513-47e4-9309-ce245dcebdce None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.821354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47775ccb-69fe-4489-8804-bd0562289889 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.824617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91ffac-4513-47e4-9309-ce245dcebdce None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.826654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.827380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.827659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.828126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.828894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:02.829258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.829754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.830421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.830828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.830929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.831148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.831909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:02.832245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.834072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.845105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 795/1569] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:02.846004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 775/1570] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:02.846904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.853099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.857350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba781-e897-4c24-8935-0c5092f5ad3b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.862983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.863747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.863907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.864179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa8a09-e9e4-4c6e-b91e-abba41898bb5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.864335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.864913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:02.865318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.866931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.868924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.869598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.869878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.870148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.871336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:02.871336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.872783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.880040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 776/1571] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:02.880740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.892070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cd8b1-a311-48c5-b1c5-7ff7d33f0c80 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.895311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 796/1572] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:02.896231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.904036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.905030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.905473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.905900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.906806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:02.907395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.909895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.912150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df00c-2832-44f6-872d-f72a55b05d92 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.918766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.919704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.920088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.920546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] PATH_INFO: `/v3/projects/f211dbe09fc34141b9d519a6e69c8dc2/users/a1ccfbe59f4841a093c71c75585fb2ba/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.932250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 777/1573] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:02.932250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.939387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06104d2d-cee4-4729-9d53-e06d8fbec207 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:02.941213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f211dbe09fc34141b9d519a6e69c8dc2, user_id=a1ccfbe59f4841a093c71c75585fb2ba, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.944109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.946238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:02.947323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:02.947323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:02.947689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:02.948536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:02.948942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:02.950635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:02.963294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 797/1574] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:02 2022] PUT /identity/v3/projects/f211dbe09fc34141b9d519a6e69c8dc2/users/a1ccfbe59f4841a093c71c75585fb2ba/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:02.963468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 778/1575] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:02.964730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.967724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:02.981504 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aa016-871e-4e4a-a2a0-7b232d51f922 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.037372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e94146-35fd-4225-b068-8ecb11bc6620 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.041901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.042712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.043082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.043454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.044151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.045196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:58:03.045196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:58:03.045196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:58:03.046357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.047117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.047856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.048235 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.048570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.049347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.051349 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.083136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 798/1576] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.083136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.087970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 779/1577] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:02 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.088977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.165411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90602a0-dd38-46e7-9c20-c908a7460c4d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.167381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1882a2-9fe7-48cc-8f6d-490d47419b60 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.170845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.171701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.171987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.172269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.173016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.173566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d742f-dc64-4a73-a178-e8013367c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.174406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d742f-dc64-4a73-a178-e8013367c73b admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.174910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d742f-dc64-4a73-a178-e8013367c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.175134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.177188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d742f-dc64-4a73-a178-e8013367c73b admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.177935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d742f-dc64-4a73-a178-e8013367c73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.180100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d742f-dc64-4a73-a178-e8013367c73b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.207882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 799/1578] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.208436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 780/1579] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.208953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.213738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511da61a-b186-42d9-bd58-6b6b517373b5 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.214103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511da61a-b186-42d9-bd58-6b6b517373b5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.214443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511da61a-b186-42d9-bd58-6b6b517373b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.232056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-511da61a-b186-42d9-bd58-6b6b517373b5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:03.233287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-511da61a-b186-42d9-bd58-6b6b517373b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:03.281577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929dd0-8cac-4991-88be-b34c4533e116 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.298425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 781/1580] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:03.298425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511da61a-b186-42d9-bd58-6b6b517373b5 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.306473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511da61a-b186-42d9-bd58-6b6b517373b5 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.311520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.312577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.313673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.313673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.314263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.317204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.342406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.343084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.343499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.343785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.344485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.346435 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.347193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 782/1581] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.347906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.379352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 800/1582] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.380185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.420345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520812-9581-4520-ac16-894a4ced9f27 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.452789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919579c1-2af5-46f8-a0df-59931455459a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.462711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.463946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.468331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.468647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.469409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.471734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.499685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 801/1583] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.499685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.511352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2abf2-5be6-47e6-ba8b-e35140ab2a7c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.519049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.520137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.520644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.521048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.521924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.524835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.529483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.530365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.530991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.531439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.532569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.535224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.557706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 802/1584] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.558720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.559360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 783/1585] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.560561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.580168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56c582-13bb-43e9-9f1a-b78ef821b5ea admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.587304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.588005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.588637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.589071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.589801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.591844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.630968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 803/1586] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/users => generated 284 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.631912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.644973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26356e67-cf6d-4d0f-8d01-7131cab846c5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.649832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.650589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.650877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.651153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.651850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.654128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.666385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f805b5e-1868-4a83-bf4e-d458d1bb9759 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.671283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.672460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.672460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.672801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.685277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.686739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.690019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 804/1587] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/users => generated 286 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.691555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.698651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 784/1588] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:03.699439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.713701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea8a8-feaf-4d48-ab63-328cacf4fb28 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.719809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.720563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.720951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.721871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.722172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.722546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8d8f0-b86d-4157-aacb-63919cd46dc2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.723989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.731234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.732121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.732505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.733367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.734588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.736901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.746391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 785/1589] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.746391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.758954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e3e1-f0f8-4bf0-8052-ff89aadcdf3b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.765866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.766550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.766926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.767299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.768166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.770090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.776518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 805/1590] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:03 2022] POST /identity/v3/users => generated 296 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:03.777524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.787977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 786/1591] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.789299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.789865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe745603-8d98-43a3-be02-2bc2a9e6112f admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.796105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.797063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.797516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.797999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.799089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.800966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.810739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68177389-af82-44b6-a903-fa2412698444 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.817601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.818915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.819377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.819659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.820549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.822372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.836983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 806/1592] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.836983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.837280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 787/1593] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.837622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.850802 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6aede-2b51-428b-9f2a-0df4b9b8244d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.859210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.860367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.860842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.861340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.861782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844cd67-e74c-45e2-83f6-5eeba114d3e9 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.862989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.865702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.871427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.872291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.872560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.872903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.873692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.875483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.880396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 788/1594] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.881374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.894226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 807/1595] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.894950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.902605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c9114-5564-4ed3-83d1-88d0dcdb320f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.913263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a2f75-11a7-497e-a0ca-4651845ab751 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.913516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.913959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.914240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.914514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.915254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.916928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.922842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.924543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.925718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.926035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.928016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.929997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.945325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 789/1596] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.946354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.950690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 808/1597] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:03.951570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:03.966251 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150355e5-3559-4dd5-a648-1a174c3d9d84 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.971108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e585-00b7-4184-a57d-e1ab6d5fb7a2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:03.985434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.986128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.986421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.986546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:03.986751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.987274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:03.987454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.987571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:03.987791 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:03.988774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:03.989740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:03.990923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.008488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 809/1598] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:04.010515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.014857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 790/1599] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:04.015776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.021616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3027db4-16f5-47e0-8a48-080c63117ded admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.027921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.029056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.029494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.030402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] PATH_INFO: `/v3/projects/08319d2b6ebf4a40830d212321cb6b63/users/68b1c1f3865042b1bb208cc36b612c55/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.035882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de4a8-2b1d-499f-bf2d-4f6ebe69ad1a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.049655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.050387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.050676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.050938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.051680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.054116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.055343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08319d2b6ebf4a40830d212321cb6b63, user_id=68b1c1f3865042b1bb208cc36b612c55, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.059188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.084375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 791/1601] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:04.085399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.099139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 810/1601] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:04 2022] PUT /identity/v3/projects/08319d2b6ebf4a40830d212321cb6b63/users/68b1c1f3865042b1bb208cc36b612c55/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:04.099139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.111070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332dc5f-cc9e-4607-87ed-06bcad31d222 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.237626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.238326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.238638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.239070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.239946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.242201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.251639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78cce8-74d9-4d8c-9e35-0288eeb4ab76 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.265724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 792/1602] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:04.266861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.267916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.272068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.273023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.274053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] PATH_INFO: `/v3/projects/e17dd3da9fc545fc901dc35e62332ab6/users/ecc2540fdbe64849b897ae1b7cefe109/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.285849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f5b8f-4665-4474-ad2d-20bc7d4ddd0c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.300792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.301715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.302048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.302332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] PATH_INFO: `/v3/projects/31d4c2c179254e91953448f46c6f6ef6/users/509ec923609f4f669b73a95747f97dc9/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.312736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17dd3da9fc545fc901dc35e62332ab6, user_id=ecc2540fdbe64849b897ae1b7cefe109, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.317175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.335843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d4c2c179254e91953448f46c6f6ef6, user_id=509ec923609f4f669b73a95747f97dc9, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.338791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.360363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 811/1603] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:04 2022] PUT /identity/v3/projects/e17dd3da9fc545fc901dc35e62332ab6/users/ecc2540fdbe64849b897ae1b7cefe109/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:04.362485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.366785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 793/1604] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:04 2022] PUT /identity/v3/projects/31d4c2c179254e91953448f46c6f6ef6/users/509ec923609f4f669b73a95747f97dc9/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:04.367744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.507612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2fbd1-b96c-4c65-bb34-f257c0bcbe8c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.514141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5567d-f0c8-43c5-8949-3e3750c54e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.515082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5567d-f0c8-43c5-8949-3e3750c54e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.515529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5567d-f0c8-43c5-8949-3e3750c54e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.516277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5567d-f0c8-43c5-8949-3e3750c54e0f admin admin] PATH_INFO: `/v3/projects/05a6b2c4cfba4d67b94d5a4712771c1f/users/d65cf9d4e9eb4d818d7fedfc9ccb3745/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.525054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9017c99-7265-4c44-8760-f786ef1529fe admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.531333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.532918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.533200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.533478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] PATH_INFO: `/v3/projects/78dc305288844d31b96ce03cca84d0de/users/0b5b19eaf0f946a9a0d531badc8a0bae/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.543454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5567d-f0c8-43c5-8949-3e3750c54e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a6b2c4cfba4d67b94d5a4712771c1f, user_id=d65cf9d4e9eb4d818d7fedfc9ccb3745, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.548381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5567d-f0c8-43c5-8949-3e3750c54e0f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.575551 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78dc305288844d31b96ce03cca84d0de, user_id=0b5b19eaf0f946a9a0d531badc8a0bae, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.580161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.583685 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 794/1605] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:04 2022] PUT /identity/v3/projects/05a6b2c4cfba4d67b94d5a4712771c1f/users/d65cf9d4e9eb4d818d7fedfc9ccb3745/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:04.591707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d03-fb7a-4c72-92d4-09560cc13ea4 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.591707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d03-fb7a-4c72-92d4-09560cc13ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.591707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d03-fb7a-4c72-92d4-09560cc13ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.601625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 812/1606] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:04 2022] PUT /identity/v3/projects/78dc305288844d31b96ce03cca84d0de/users/0b5b19eaf0f946a9a0d531badc8a0bae/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:04.602441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.614945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5f608d03-fb7a-4c72-92d4-09560cc13ea4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:04.616199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5f608d03-fb7a-4c72-92d4-09560cc13ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:04.717685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6bc0-933a-4020-90dd-3e71ea0fc358 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:04.723900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50cc34-c9fd-4c01-8597-eca6ed2e0e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:04.725396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50cc34-c9fd-4c01-8597-eca6ed2e0e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.725917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50cc34-c9fd-4c01-8597-eca6ed2e0e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.726053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 795/1607] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:04.726672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50cc34-c9fd-4c01-8597-eca6ed2e0e97 admin admin] PATH_INFO: `/v3/projects/c8a8587fef8146ffbdb51b45da483da7/users/74e841af26ef499fa45e27c0eba025c9/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.728390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e815a9-318a-4e9b-a08d-7d08971a0769 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.728710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e815a9-318a-4e9b-a08d-7d08971a0769 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.729123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e815a9-318a-4e9b-a08d-7d08971a0769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.759787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50cc34-c9fd-4c01-8597-eca6ed2e0e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a8587fef8146ffbdb51b45da483da7, user_id=74e841af26ef499fa45e27c0eba025c9, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:04.762658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50cc34-c9fd-4c01-8597-eca6ed2e0e97 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:04.781265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-e8e815a9-318a-4e9b-a08d-7d08971a0769 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:04.791391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e8e815a9-318a-4e9b-a08d-7d08971a0769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:04.791820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 813/1608] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:04 2022] PUT /identity/v3/projects/c8a8587fef8146ffbdb51b45da483da7/users/74e841af26ef499fa45e27c0eba025c9/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:04.795250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e00b8-5216-4cf8-aa9d-7ea878af442d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.795841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e00b8-5216-4cf8-aa9d-7ea878af442d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.796301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e00b8-5216-4cf8-aa9d-7ea878af442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.827850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-d22e00b8-5216-4cf8-aa9d-7ea878af442d None None] MFA Rules not processed for user `509ec923609f4f669b73a95747f97dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:04.829213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d22e00b8-5216-4cf8-aa9d-7ea878af442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:04.906321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 814/1609] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:04.911750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 796/1610] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:04.913991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ce32-ea72-4a41-bbae-35e27dcda8fe None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.914286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ce32-ea72-4a41-bbae-35e27dcda8fe None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.914673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ce32-ea72-4a41-bbae-35e27dcda8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.919657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b0170-8b7d-4c85-b509-dce116c5ca90 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:04.920117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b0170-8b7d-4c85-b509-dce116c5ca90 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:04.920771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b0170-8b7d-4c85-b509-dce116c5ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:04.935979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-2ce0ce32-ea72-4a41-bbae-35e27dcda8fe None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:04.938018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2ce0ce32-ea72-4a41-bbae-35e27dcda8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:04.951074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 797/1611] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:04.951074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ce32-ea72-4a41-bbae-35e27dcda8fe None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:04.952754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e09b0170-8b7d-4c85-b509-dce116c5ca90 None None] MFA Rules not processed for user `d65cf9d4e9eb4d818d7fedfc9ccb3745`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:04.954243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e09b0170-8b7d-4c85-b509-dce116c5ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:05.029758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ce32-ea72-4a41-bbae-35e27dcda8fe None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.036058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.046424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.046424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.046424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.096969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 815/1612] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:05.097992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8023-9318-4633-b702-bcf72795f519 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.098294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8023-9318-4633-b702-bcf72795f519 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.098570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8023-9318-4633-b702-bcf72795f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.099521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.101427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:05.129203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 798/1613] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:05.132116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.150830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-729e8023-9318-4633-b702-bcf72795f519 None None] MFA Rules not processed for user `74e841af26ef499fa45e27c0eba025c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:05.152729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-729e8023-9318-4633-b702-bcf72795f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:05.268076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256335-14b9-41a5-a23d-5a53e50b6724 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.275408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.277597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.278250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.278921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.300380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.303895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:05.315795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 816/1614] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:05.319417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8023-9318-4633-b702-bcf72795f519 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.319528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 799/1615] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:05.319833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.331565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2980f5f-6766-4265-9490-f0e9cd097fd7 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.337398 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.338266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.338618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.339016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.340860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8023-9318-4633-b702-bcf72795f519 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.354512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.356936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:05.367078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.369358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.369746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 800/1616] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:05.371601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.372560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.373941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.394091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65609989-10d8-45f8-96b3-f0699855d22e service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.405133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.405700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.406527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.407837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.407837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.409427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:05.410230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.414985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:05.437001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 817/1617] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:05.441955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.496630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173814cb-3183-4fa5-b4e8-1a324852d4c3 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.501543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 801/1618] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:05 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:05.505690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.759046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.760876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.763138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.763452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.766654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.767665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222a670-a7f1-4ca7-a0ea-2530ae6b1c18 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.777313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:05.786761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.787758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.788149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.788526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.789393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.793726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:05.845556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 818/1619] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:05 2022] POST /identity/v3/projects => generated 393 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:05.851044 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.851273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 802/1620] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:05 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:05.854975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:05.880224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d5ab-c454-429c-80c6-b4c17a2d6ce2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:05.984694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:05.985758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:05.985758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:05.986033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:05.986935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:05.989293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:06.009745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 803/1621] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:06.010855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:06.025214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ac5d5-069a-4222-8ba6-7d3ba58e9294 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:06.031340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:06.032371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:06.032698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:06.033052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] PATH_INFO: `/v3/projects/ce4531ef37f747c68cb36c577f78c283/users/a7641682b28949c5a9ed801fb0aea5ae/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:06.052759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4531ef37f747c68cb36c577f78c283, user_id=a7641682b28949c5a9ed801fb0aea5ae, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:06.056250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:06.081931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 804/1622] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:06 2022] PUT /identity/v3/projects/ce4531ef37f747c68cb36c577f78c283/users/a7641682b28949c5a9ed801fb0aea5ae/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:06.086377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:06.184824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084912d2-cd15-408f-be21-c8005a18d412 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:06.194699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:06.195409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:06.195696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:06.195951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:06.200661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:06.202451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:06.225503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 805/1623] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:06.230484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:06.236418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb08d-8683-4bd0-ad05-1ba622dc5422 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:06.242612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b754a-2988-4cb3-9571-2680f1ae3e07 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:06.258630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6b00b-26d2-4895-80f0-945264b1412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:06.260303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:06.261522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:06.262007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:06.262493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:06.264104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:06.267900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:06.272383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b00b-26d2-4895-80f0-945264b1412f admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:06.274745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b00b-26d2-4895-80f0-945264b1412f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:06.276517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b00b-26d2-4895-80f0-945264b1412f admin admin] PATH_INFO: `/v3/projects/ce4531ef37f747c68cb36c577f78c283/users/a7641682b28949c5a9ed801fb0aea5ae/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:06.286716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6b00b-26d2-4895-80f0-945264b1412f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4531ef37f747c68cb36c577f78c283, user_id=a7641682b28949c5a9ed801fb0aea5ae, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:06.303385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6b00b-26d2-4895-80f0-945264b1412f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:06.354266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 819/1624] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:05 2022] POST /identity/v3/users => generated 303 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:06.359063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:06.388253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 806/1625] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:06 2022] PUT /identity/v3/projects/ce4531ef37f747c68cb36c577f78c283/users/a7641682b28949c5a9ed801fb0aea5ae/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:06.401711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42eabe-c29b-4969-8382-0012519f4586 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:06.402257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42eabe-c29b-4969-8382-0012519f4586 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:06.402689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42eabe-c29b-4969-8382-0012519f4586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:06.421704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1687277-2ba2-473e-80e8-02585f9abc2b admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:06.492586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-dc42eabe-c29b-4969-8382-0012519f4586 None None] MFA Rules not processed for user `a7641682b28949c5a9ed801fb0aea5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:06.494846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-dc42eabe-c29b-4969-8382-0012519f4586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:06.772169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:06.778052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:06.778683 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:06.779328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:06.785072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:06.788220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:06.808321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 807/1626] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:06.823509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 820/1627] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:06.828052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42eabe-c29b-4969-8382-0012519f4586 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:06.852520 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:06.854469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42eabe-c29b-4969-8382-0012519f4586 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:06.886269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:06.890002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:06.892728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:06.894081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] PATH_INFO: `/v3/projects/cd06e9120996451da16d408f4c73b5b5/users/fb1773737361406d8e821268d930b163/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:06.973515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd06e9120996451da16d408f4c73b5b5, user_id=fb1773737361406d8e821268d930b163, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:06.988059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:07.039715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 808/1628] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:06 2022] PUT /identity/v3/projects/cd06e9120996451da16d408f4c73b5b5/users/fb1773737361406d8e821268d930b163/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:07.044333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:07.108630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ffb9-4c58-49d5-bc92-b02039ee1df5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:07.272777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa48b4-4252-43a8-9ba1-dbaaa608fb97 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:07.287422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:07.288128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:07.288409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:07.288749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:07.289650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:07.299486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:07.313549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:07.314700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:07.315218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:07.316167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:07.320265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 809/1629] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:07.320831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:07.346983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c890a24-36fb-4e3d-b1a9-2e754d208b0b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:07.359077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42602c-e18b-48ca-8191-1589ed01fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:07.360247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42602c-e18b-48ca-8191-1589ed01fcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:07.360580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42602c-e18b-48ca-8191-1589ed01fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:07.360933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42602c-e18b-48ca-8191-1589ed01fcf9 admin admin] PATH_INFO: `/v3/projects/cd06e9120996451da16d408f4c73b5b5/users/fb1773737361406d8e821268d930b163/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:07.364037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42602c-e18b-48ca-8191-1589ed01fcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd06e9120996451da16d408f4c73b5b5, user_id=fb1773737361406d8e821268d930b163, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:07.367407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42602c-e18b-48ca-8191-1589ed01fcf9 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:07.398973 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 810/1630] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:07 2022] PUT /identity/v3/projects/cd06e9120996451da16d408f4c73b5b5/users/fb1773737361406d8e821268d930b163/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:07.401300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883cdab-9ccc-49d0-b9ed-fa8fc7b992a3 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:07.401823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883cdab-9ccc-49d0-b9ed-fa8fc7b992a3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:07.402295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883cdab-9ccc-49d0-b9ed-fa8fc7b992a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:07.510189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-0883cdab-9ccc-49d0-b9ed-fa8fc7b992a3 None None] MFA Rules not processed for user `fb1773737361406d8e821268d930b163`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:07.518065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0883cdab-9ccc-49d0-b9ed-fa8fc7b992a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:07.567980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:07.569489 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:07.598254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 821/1631] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:07.825437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 811/1632] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:07.894161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:07.917337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f1ed-ff5c-4c30-b5f4-b83f8f2758ab service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:08.079112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ce42-1bfb-460c-8b36-99f7136a658d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:08.079808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ce42-1bfb-460c-8b36-99f7136a658d service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:08.080262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ce42-1bfb-460c-8b36-99f7136a658d service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:08.081970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ce42-1bfb-460c-8b36-99f7136a658d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:08.109134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ce42-1bfb-460c-8b36-99f7136a658d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:08.113204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ce42-1bfb-460c-8b36-99f7136a658d service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:08.148355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 822/1633] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:08.359962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883cdab-9ccc-49d0-b9ed-fa8fc7b992a3 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:08.379454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883cdab-9ccc-49d0-b9ed-fa8fc7b992a3 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:08.393505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45f59b-14b5-45d6-9f42-2f99576f0888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:08.394381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f59b-14b5-45d6-9f42-2f99576f0888 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:08.394659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f59b-14b5-45d6-9f42-2f99576f0888 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:08.395142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f59b-14b5-45d6-9f42-2f99576f0888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:08.551534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45f59b-14b5-45d6-9f42-2f99576f0888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:08.554287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45f59b-14b5-45d6-9f42-2f99576f0888 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:08.588959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 812/1634] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:58:08.636827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28af7-0521-4a84-bc00-6c0f9713fdc7 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:08.637126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28af7-0521-4a84-bc00-6c0f9713fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:08.637408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28af7-0521-4a84-bc00-6c0f9713fdc7 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:08.639571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 823/1635] 10.222.0.52 () {54 vars in 961 bytes} [Tue May 10 18:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:08.646322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62292-872c-468d-b04b-edf9111731af None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:08.646599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62292-872c-468d-b04b-edf9111731af None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:08.646879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62292-872c-468d-b04b-edf9111731af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:08.670975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-29f62292-872c-468d-b04b-edf9111731af None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:08.673098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-29f62292-872c-468d-b04b-edf9111731af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:08.832630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 813/1636] 10.222.0.52 () {58 vars in 1058 bytes} [Tue May 10 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:08.838351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae799e-a2c2-4a8e-a289-c3cac936412c None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:08.838639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae799e-a2c2-4a8e-a289-c3cac936412c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:08.838921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae799e-a2c2-4a8e-a289-c3cac936412c None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:08.840272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 824/1637] 10.222.0.52 () {54 vars in 912 bytes} [Tue May 10 18:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:58:08.846861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ba1a-ba0c-4e69-8026-d03b696a5a31 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:08.847306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ba1a-ba0c-4e69-8026-d03b696a5a31 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:08.847640 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ba1a-ba0c-4e69-8026-d03b696a5a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:08.865682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae799e-a2c2-4a8e-a289-c3cac936412c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:08.889595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1f77ba1a-ba0c-4e69-8026-d03b696a5a31 None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:08.892584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1f77ba1a-ba0c-4e69-8026-d03b696a5a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:08.922676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 814/1638] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:08.947025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77ba1a-ba0c-4e69-8026-d03b696a5a31 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:08.959929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77ba1a-ba0c-4e69-8026-d03b696a5a31 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:08.973618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c530464-7e0a-4156-bfcc-225f04ca5699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:08.974182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530464-7e0a-4156-bfcc-225f04ca5699 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:08.974455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530464-7e0a-4156-bfcc-225f04ca5699 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:08.974774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530464-7e0a-4156-bfcc-225f04ca5699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:09.000862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c530464-7e0a-4156-bfcc-225f04ca5699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:09.002736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c530464-7e0a-4156-bfcc-225f04ca5699 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:09.034666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 815/1639] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:09.039337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae799e-a2c2-4a8e-a289-c3cac936412c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:09.052726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:09.055735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:09.056601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:09.058585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] PATH_INFO: `/v3/users/d65cf9d4e9eb4d818d7fedfc9ccb3745` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:09.061956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65cf9d4e9eb4d818d7fedfc9ccb3745)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:09.063416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: WARNING py.warnings [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:58:09.063416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: warnings.warn(msg) May 10 18:58:09.063416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: May 10 18:58:09.065500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:09.227989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65cf9d4e9eb4d818d7fedfc9ccb3745'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:09.229662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65cf9d4e9eb4d818d7fedfc9ccb3745'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:09.271072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65cf9d4e9eb4d818d7fedfc9ccb3745'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:09.344739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65cf9d4e9eb4d818d7fedfc9ccb3745'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:09.385623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65cf9d4e9eb4d818d7fedfc9ccb3745'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:09.405533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 825/1640] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:08 2022] DELETE /identity/v3/users/d65cf9d4e9eb4d818d7fedfc9ccb3745 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:09.411774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:09.412466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:09.412722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:09.443662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:09.446412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:09.555672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 816/1641] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:09.605118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:09.605265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:09.773616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1a6b-7fd8-4a02-8fb3-5ae6a144cdd2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:09.789404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:09.790099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:09.790388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:09.790669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:09.825690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:09.827075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:09.851342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 826/1642] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:58:11.398563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:11.402466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:11.424872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec3a40-9c19-477c-9ee0-5541b1e8f984 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:11.441285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:11.442191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:11.442629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:11.442973 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] PATH_INFO: `/v3/projects/05a6b2c4cfba4d67b94d5a4712771c1f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:11.447353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a6b2c4cfba4d67b94d5a4712771c1f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:11.448820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: WARNING py.warnings [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 18:58:11.448820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: warnings.warn(msg) May 10 18:58:11.448820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: May 10 18:58:11.450053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:11.595663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a6b2c4cfba4d67b94d5a4712771c1f', 'request_id': 'req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:11.621581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a6b2c4cfba4d67b94d5a4712771c1f', 'request_id': 'req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:11.646638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a6b2c4cfba4d67b94d5a4712771c1f', 'request_id': 'req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:11.670607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] The token cache is being invalidate because project 05a6b2c4cfba4d67b94d5a4712771c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:11.671180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:11.673123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-cfb4c0b6-eab8-43d3-a137-0db50420e9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:11.679845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 817/1643] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:11 2022] DELETE /identity/v3/projects/05a6b2c4cfba4d67b94d5a4712771c1f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:11.683778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:11.696802 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3ec1d-417e-4268-8c67-44b56a585c6e service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:11.721982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883c8f-7952-4fb7-89d0-349c13f8e48f None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:11.722302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883c8f-7952-4fb7-89d0-349c13f8e48f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:11.722615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883c8f-7952-4fb7-89d0-349c13f8e48f None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:11.724146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 818/1644] 10.222.0.52 () {54 vars in 961 bytes} [Tue May 10 18:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 18:58:11.730538 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3cf1-8ce5-462b-8ed8-8108f1b17616 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:11.730827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3cf1-8ce5-462b-8ed8-8108f1b17616 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:11.731108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3cf1-8ce5-462b-8ed8-8108f1b17616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:11.773562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-daee3cf1-8ce5-462b-8ed8-8108f1b17616 None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:11.774859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-daee3cf1-8ce5-462b-8ed8-8108f1b17616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:11.858532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:11.898728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:11.898728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:11.898728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] PATH_INFO: `/v3/users/a7641682b28949c5a9ed801fb0aea5ae` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:11.898728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7641682b28949c5a9ed801fb0aea5ae)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:11.898728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:11.982309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 819/1645] 10.222.0.52 () {58 vars in 1058 bytes} [Tue May 10 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 10 18:58:11.990321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bffe9-9379-4fde-b093-b3e783bd8612 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:11.990867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bffe9-9379-4fde-b093-b3e783bd8612 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:12.020730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bffe9-9379-4fde-b093-b3e783bd8612 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:12.031681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7641682b28949c5a9ed801fb0aea5ae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:12.032312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 820/1646] 10.222.0.52 () {54 vars in 912 bytes} [Tue May 10 18:58:11 2022] GET /identity => generated 270 bytes in 44 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:12.032912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7641682b28949c5a9ed801fb0aea5ae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:12.038816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d529a2-3f64-4788-b428-26458ec241db None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:12.040031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d529a2-3f64-4788-b428-26458ec241db None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:12.040514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d529a2-3f64-4788-b428-26458ec241db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:12.052591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7641682b28949c5a9ed801fb0aea5ae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:12.078294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7641682b28949c5a9ed801fb0aea5ae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:12.093939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-41822d54-feae-46d2-94a6-acc4f95f01cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7641682b28949c5a9ed801fb0aea5ae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:12.107465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 827/1647] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:11 2022] DELETE /identity/v3/users/a7641682b28949c5a9ed801fb0aea5ae => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:12.117024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-39d529a2-3f64-4788-b428-26458ec241db None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:12.119634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-39d529a2-3f64-4788-b428-26458ec241db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:12.164987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:12.165279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:12.165555 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:12.202686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] MFA Rules not processed for user `0b5b19eaf0f946a9a0d531badc8a0bae`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:12.204010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:12.282921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 821/1648] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:12.290350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d529a2-3f64-4788-b428-26458ec241db None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:12.294800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-39d529a2-3f64-4788-b428-26458ec241db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:12.447012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d529a2-3f64-4788-b428-26458ec241db None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:12.456747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840da97-fbdd-425a-b272-a27434114994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:12.457638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840da97-fbdd-425a-b272-a27434114994 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:12.458067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840da97-fbdd-425a-b272-a27434114994 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:12.458506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840da97-fbdd-425a-b272-a27434114994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:12.494141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840da97-fbdd-425a-b272-a27434114994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:12.497828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840da97-fbdd-425a-b272-a27434114994 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:12.550836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 822/1649] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:12.676067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 828/1650] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:12.691352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:12.691629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:12.691932 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:12.720241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] MFA Rules not processed for user `0b5b19eaf0f946a9a0d531badc8a0bae`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:12.724955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:12.743836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 823/1651] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:12.758634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:12.760144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:12.792372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e8dd8-4b31-4769-83f7-b7e4b498d145 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:12.805295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e8cba-793b-4cbc-a651-98920f152ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:12.807120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e8cba-793b-4cbc-a651-98920f152ecf service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:12.808116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e8cba-793b-4cbc-a651-98920f152ecf service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:12.809156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e8cba-793b-4cbc-a651-98920f152ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:12.829369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e8cba-793b-4cbc-a651-98920f152ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:12.831516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e8cba-793b-4cbc-a651-98920f152ecf service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:12.865762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 829/1652] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:13.728888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:13.730406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:13.870435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799480f-a832-4ddf-9178-3283c2bc1e16 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:13.875537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:13.880173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:13.880828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:13.881245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] PATH_INFO: `/v3/users/74e841af26ef499fa45e27c0eba025c9` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:13.882858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e841af26ef499fa45e27c0eba025c9)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:13.885163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:13.961634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e841af26ef499fa45e27c0eba025c9'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:13.963660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e841af26ef499fa45e27c0eba025c9'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:13.981844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e841af26ef499fa45e27c0eba025c9'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:13.996430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e841af26ef499fa45e27c0eba025c9'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:14.010998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e841af26ef499fa45e27c0eba025c9'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:14.022325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 824/1653] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:13 2022] DELETE /identity/v3/users/74e841af26ef499fa45e27c0eba025c9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:14.026779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.027652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.028054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.064862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:14.066219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:14.193513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 830/1654] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:14.227619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:14.229190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:14.249417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:14.251198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:14.265552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f6f56-b08a-478c-bc22-f5446bd6d845 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:14.272603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:14.273644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.273903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.274189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] PATH_INFO: `/v3/projects/ce4531ef37f747c68cb36c577f78c283` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.279422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4531ef37f747c68cb36c577f78c283)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:14.300310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:14.416505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab6d42-1e63-4d46-a81e-2b60a1ce5103 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:14.444337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4531ef37f747c68cb36c577f78c283', 'request_id': 'req-ba05a0a9-ad1d-470f-a4f6-779130d80c97'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:14.483882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4531ef37f747c68cb36c577f78c283', 'request_id': 'req-ba05a0a9-ad1d-470f-a4f6-779130d80c97'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:14.491560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4531ef37f747c68cb36c577f78c283', 'request_id': 'req-ba05a0a9-ad1d-470f-a4f6-779130d80c97'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:14.524541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] The token cache is being invalidate because project ce4531ef37f747c68cb36c577f78c283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:14.524894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:14.526350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ba05a0a9-ad1d-470f-a4f6-779130d80c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:14.536720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 825/1655] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:14 2022] DELETE /identity/v3/projects/ce4531ef37f747c68cb36c577f78c283 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:14.538132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7efdb-edd9-4195-aa43-5eb1ebb32914 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.538422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7efdb-edd9-4195-aa43-5eb1ebb32914 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.538701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7efdb-edd9-4195-aa43-5eb1ebb32914 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.540129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 826/1656] 10.222.0.52 () {54 vars in 912 bytes} [Tue May 10 18:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:14.541242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358540d9-0eae-4514-a3bd-60189affb2b4 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.541526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358540d9-0eae-4514-a3bd-60189affb2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.541836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358540d9-0eae-4514-a3bd-60189affb2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.593933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-358540d9-0eae-4514-a3bd-60189affb2b4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:14.595149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-358540d9-0eae-4514-a3bd-60189affb2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:14.613511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fbccc-342e-4ee9-90ff-3bd04e4cf161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:14.615107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fbccc-342e-4ee9-90ff-3bd04e4cf161 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.615691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fbccc-342e-4ee9-90ff-3bd04e4cf161 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.616779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fbccc-342e-4ee9-90ff-3bd04e4cf161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.623271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b37fbccc-342e-4ee9-90ff-3bd04e4cf161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:14.847710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 827/1657] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:14.847710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207bea4-5115-4e79-ab8e-05f9e53fd564 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.847710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207bea4-5115-4e79-ab8e-05f9e53fd564 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.847710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207bea4-5115-4e79-ab8e-05f9e53fd564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.858084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fbccc-342e-4ee9-90ff-3bd04e4cf161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:14.859538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fbccc-342e-4ee9-90ff-3bd04e4cf161 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:14.870117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 831/1658] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:14.872005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550236-fcad-40f9-9714-2e0f16bf75ca None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.872297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550236-fcad-40f9-9714-2e0f16bf75ca None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.872571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550236-fcad-40f9-9714-2e0f16bf75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.891410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-57550236-fcad-40f9-9714-2e0f16bf75ca None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:14.899393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-57550236-fcad-40f9-9714-2e0f16bf75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:14.914638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 832/1659] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:14.918984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57550236-fcad-40f9-9714-2e0f16bf75ca None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:14.935877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57550236-fcad-40f9-9714-2e0f16bf75ca None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:14.952749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:14.953557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:14.953838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:14.954011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8207bea4-5115-4e79-ab8e-05f9e53fd564 None None] MFA Rules not processed for user `945283f83c1b4ee0a1a59b0732090fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:14.954111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:14.954929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:14.955243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:14.955343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8207bea4-5115-4e79-ab8e-05f9e53fd564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:14.957513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:14.972924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 828/1660] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:14.987685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 833/1661] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:14.989051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207bea4-5115-4e79-ab8e-05f9e53fd564 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:15.008276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207bea4-5115-4e79-ab8e-05f9e53fd564 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:15.013211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:15.014135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.014494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.014843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.015780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:15.017935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:15.060255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:15.064355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:15.085042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 829/1662] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:14 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:15.088459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:15.115280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25b9d8-f28d-4631-bfb8-c75275b8ba0b admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:15.278930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73d56d-6e87-4778-a438-c784c8bcc1af admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:15.280572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:15.281332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.281613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.281888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.294754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:15.300775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:15.302204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:15.307947 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.308861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.310457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.314652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:15.324720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:15.337713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 834/1663] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:15.384300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 830/1664] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:15 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:15.388724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:15.407074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4a300-cb61-4eb8-a9da-bf3b0f0fe209 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:15.420577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:15.423338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.423634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.429478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.430397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:15.432184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:15.462008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 835/1665] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:15.462219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:15.480609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc79a9-9746-499a-b948-17967150998e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:15.492269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d48c3c-a0ff-48dd-a542-118906ab6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:15.493026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d48c3c-a0ff-48dd-a542-118906ab6e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.493309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d48c3c-a0ff-48dd-a542-118906ab6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.493648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d48c3c-a0ff-48dd-a542-118906ab6e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.494407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d48c3c-a0ff-48dd-a542-118906ab6e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:15.496026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d48c3c-a0ff-48dd-a542-118906ab6e55 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:15.517875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 831/1666] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:15.522432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:15.537718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba10a-639b-4b2f-9cb7-b9a1ca928903 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:15.569670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:15.570609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.570894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.571174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] PATH_INFO: `/v3/projects/61b421176f834b27b365622111b2e4ab/users/6d055d9ddcb14276a139c92a273b1c17/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.602721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b421176f834b27b365622111b2e4ab, user_id=6d055d9ddcb14276a139c92a273b1c17, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:15.607650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:15.642363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 836/1667] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:15 2022] PUT /identity/v3/projects/61b421176f834b27b365622111b2e4ab/users/6d055d9ddcb14276a139c92a273b1c17/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:15.652584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42c33-bf33-4676-853d-1c7985e2a34e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.652901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42c33-bf33-4676-853d-1c7985e2a34e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.653181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42c33-bf33-4676-853d-1c7985e2a34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.700909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-13c42c33-bf33-4676-853d-1c7985e2a34e None None] MFA Rules not processed for user `6d055d9ddcb14276a139c92a273b1c17`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:15.702417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-13c42c33-bf33-4676-853d-1c7985e2a34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:15.788725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 832/1668] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:15.792382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:15.912500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf39f2-2aeb-4686-b5e3-823077eef4cd admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:15.918855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:15.919936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.920295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.921770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.922792 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:15.926439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:15.941893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedcd0d-3e17-4c5c-a364-0a9f3ed831fa None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:15.942339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedcd0d-3e17-4c5c-a364-0a9f3ed831fa None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:15.942636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedcd0d-3e17-4c5c-a364-0a9f3ed831fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:15.989775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1dedcd0d-3e17-4c5c-a364-0a9f3ed831fa None None] MFA Rules not processed for user `9d4785218d704599b5e3481ca05a4b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:15.991046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1dedcd0d-3e17-4c5c-a364-0a9f3ed831fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:15.995246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 837/1669] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:15 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:58:15.997884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:16.124338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e495d6b-9368-43d9-a77c-1e56333b82c7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:16.146292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:16.147296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.147653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.148103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.148859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:16.151467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:16.160900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 833/1670] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:16.165384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db660607-38b9-4843-8da5-1ec73ac419f8 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.165702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db660607-38b9-4843-8da5-1ec73ac419f8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.165989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db660607-38b9-4843-8da5-1ec73ac419f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.207378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-db660607-38b9-4843-8da5-1ec73ac419f8 None None] MFA Rules not processed for user `9d4785218d704599b5e3481ca05a4b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:16.209537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-db660607-38b9-4843-8da5-1ec73ac419f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:16.219793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 838/1671] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:15 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:16.223626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:16.243382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 834/1672] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:16.251476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82851e84-1948-4f4a-b579-3e53fb125cc7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:16.269504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:16.270735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.271222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.271690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.275355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:16.284300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:16.317611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 839/1673] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:16.321743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db660607-38b9-4843-8da5-1ec73ac419f8 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:16.344878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db660607-38b9-4843-8da5-1ec73ac419f8 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:16.364665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:16.366568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:16.376773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:16.378129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.378413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.378691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] PATH_INFO: `/v3/projects/d5b7938a44f040d2adbe1890e52eea86/users/f9c1bb11f71545dcbeaf7a321d031a22/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.418869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b7938a44f040d2adbe1890e52eea86, user_id=f9c1bb11f71545dcbeaf7a321d031a22, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:16.424497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:16.466095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 835/1674] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:16 2022] PUT /identity/v3/projects/d5b7938a44f040d2adbe1890e52eea86/users/f9c1bb11f71545dcbeaf7a321d031a22/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:16.470262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:16.530863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0a628-22c5-44e6-b54d-26bb6ccca161 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:16.602912 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00ee58-71f8-4b18-bbbf-493c0b7bf019 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:16.616112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:16.616564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.616952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.617315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.618145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:16.619813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:16.646417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 836/1675] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:16.647443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:16.675750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768175f-4ba2-4f42-ab46-70f396ef92ab admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:16.698343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e48f-89e8-4365-95d3-8bc26681c3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:16.699121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e48f-89e8-4365-95d3-8bc26681c3e3 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.699339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:16.699465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e48f-89e8-4365-95d3-8bc26681c3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.699658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e48f-89e8-4365-95d3-8bc26681c3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.700392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.700810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.701176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] PATH_INFO: `/v3/projects/d5b7938a44f040d2adbe1890e52eea86/users/f9c1bb11f71545dcbeaf7a321d031a22/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.703319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b7938a44f040d2adbe1890e52eea86, user_id=f9c1bb11f71545dcbeaf7a321d031a22, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:16.706211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:16.734849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 837/1676] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:16 2022] PUT /identity/v3/projects/d5b7938a44f040d2adbe1890e52eea86/users/f9c1bb11f71545dcbeaf7a321d031a22/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:16.745392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:16.747160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:16.829479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7e48f-89e8-4365-95d3-8bc26681c3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:16.831117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7e48f-89e8-4365-95d3-8bc26681c3e3 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:16.879463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 840/1677] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:16.880940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259b67-4851-462e-941c-f8a7bfe65033 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.881224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259b67-4851-462e-941c-f8a7bfe65033 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.881510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259b67-4851-462e-941c-f8a7bfe65033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.894500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b0bff-ac4d-42a2-b1d4-0ba897ac6e80 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:16.908446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:16.909663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:16.910116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:16.910532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] PATH_INFO: `/v3/projects/c8a8587fef8146ffbdb51b45da483da7` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:16.914670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a8587fef8146ffbdb51b45da483da7)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:16.916856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:16.997489 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-57259b67-4851-462e-941c-f8a7bfe65033 None None] MFA Rules not processed for user `f9c1bb11f71545dcbeaf7a321d031a22`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:16.998772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-57259b67-4851-462e-941c-f8a7bfe65033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:17.030518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a8587fef8146ffbdb51b45da483da7', 'request_id': 'req-29508e80-cad2-47fe-9cc4-d163ef000946'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.062602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a8587fef8146ffbdb51b45da483da7', 'request_id': 'req-29508e80-cad2-47fe-9cc4-d163ef000946'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.070335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a8587fef8146ffbdb51b45da483da7', 'request_id': 'req-29508e80-cad2-47fe-9cc4-d163ef000946'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.105794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] The token cache is being invalidate because project c8a8587fef8146ffbdb51b45da483da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:17.106120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.107635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-29508e80-cad2-47fe-9cc4-d163ef000946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.111888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 838/1678] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:16 2022] DELETE /identity/v3/projects/c8a8587fef8146ffbdb51b45da483da7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:17.114935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28378082-d80e-441b-aae2-66cd92d957f3 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:17.115217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28378082-d80e-441b-aae2-66cd92d957f3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:17.115496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28378082-d80e-441b-aae2-66cd92d957f3 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:17.129000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 839/1679] 10.222.0.52 () {54 vars in 960 bytes} [Tue May 10 18:58:17 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:17.129966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28378082-d80e-441b-aae2-66cd92d957f3 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:17.142059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-28378082-d80e-441b-aae2-66cd92d957f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:17.203016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 841/1680] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:17.204387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:17.205069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:17.205069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:17.233060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] MFA Rules not processed for user `698df68d01c641c1b4455509d798d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:17.234292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:17.312139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 842/1681] 10.222.0.52 () {58 vars in 1057 bytes} [Tue May 10 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:17.312403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:17.314297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:17.341745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28378082-d80e-441b-aae2-66cd92d957f3 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:17.346748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:17.347643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:17.347929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:17.348206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] PATH_INFO: `/v3/users/fb1773737361406d8e821268d930b163` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:17.365404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1773737361406d8e821268d930b163)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:17.367430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:17.399313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0140bb1-2618-4686-bb70-536540ce5da2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:17.405592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:17.406600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:17.407019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:17.407519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:17.464247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1773737361406d8e821268d930b163'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.465354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1773737361406d8e821268d930b163'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.489259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:17.490691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:17.494147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1773737361406d8e821268d930b163'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.504541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 843/1682] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:17.514541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1773737361406d8e821268d930b163'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.517684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:17.523056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1773737361406d8e821268d930b163'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:17.539452 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 840/1683] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:17 2022] DELETE /identity/v3/users/fb1773737361406d8e821268d930b163 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:17.542681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe83f5d-734d-4b5f-9cf8-352ba598cf6d service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:17.659166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:17.661188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:17.724865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896838d-19a5-4c6f-9133-e90cdd2595cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:17.725862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896838d-19a5-4c6f-9133-e90cdd2595cd service placement] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:17.726369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896838d-19a5-4c6f-9133-e90cdd2595cd service placement] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:17.726788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896838d-19a5-4c6f-9133-e90cdd2595cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:17.729302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c896838d-19a5-4c6f-9133-e90cdd2595cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:17.754893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896838d-19a5-4c6f-9133-e90cdd2595cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:17.759196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896838d-19a5-4c6f-9133-e90cdd2595cd service placement] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:17.771242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 844/1684] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:17.779403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa78c5-522d-461b-8215-5870925709c7 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:17.790289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bf38e-18a7-4dd4-8719-1403e5e73720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:17.791320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf38e-18a7-4dd4-8719-1403e5e73720 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:17.791893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf38e-18a7-4dd4-8719-1403e5e73720 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:17.792311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf38e-18a7-4dd4-8719-1403e5e73720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:17.797904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9f3bf38e-18a7-4dd4-8719-1403e5e73720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:17.902895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bf38e-18a7-4dd4-8719-1403e5e73720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:17.915899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bf38e-18a7-4dd4-8719-1403e5e73720 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:17.929362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 841/1685] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:58:18.115874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed2f5-718c-4fa1-8be9-b3ca35e23ad6 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:18.116545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed2f5-718c-4fa1-8be9-b3ca35e23ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:18.117010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed2f5-718c-4fa1-8be9-b3ca35e23ad6 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:18.118606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 845/1686] 10.222.0.52 () {54 vars in 912 bytes} [Tue May 10 18:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:18.141157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dd7c2-6870-4d59-b069-9215bc13b78f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:18.142288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dd7c2-6870-4d59-b069-9215bc13b78f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:18.142753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dd7c2-6870-4d59-b069-9215bc13b78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:18.206230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-6d3dd7c2-6870-4d59-b069-9215bc13b78f None None] MFA Rules not processed for user `945283f83c1b4ee0a1a59b0732090fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:18.215698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6d3dd7c2-6870-4d59-b069-9215bc13b78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:18.364876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 842/1687] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:18.634608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed2f5-718c-4fa1-8be9-b3ca35e23ad6 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:18.637019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d3eed2f5-718c-4fa1-8be9-b3ca35e23ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:18.671541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed2f5-718c-4fa1-8be9-b3ca35e23ad6 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:18.685997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:18.686895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:18.688308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:18.688913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:18.710721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:18.715157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:18.747769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 846/1688] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:19.159022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:19.159547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:19.159618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:19.212701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] MFA Rules not processed for user `a1ccfbe59f4841a093c71c75585fb2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:19.213959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:19.364785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 843/1689] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:19.390923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:19.392572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:19.495137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:19.496623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:19.569781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6e6be-3846-47e4-83ff-74a38dff4af5 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:19.580256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c924d94-7b2c-4274-bc14-15f53d4e54a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:19.587583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c924d94-7b2c-4274-bc14-15f53d4e54a1 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:19.588102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c924d94-7b2c-4274-bc14-15f53d4e54a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:19.588516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c924d94-7b2c-4274-bc14-15f53d4e54a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:19.605956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c924d94-7b2c-4274-bc14-15f53d4e54a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:19.609718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c924d94-7b2c-4274-bc14-15f53d4e54a1 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:19.626768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 847/1690] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:19.709886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c93f97-d01f-452b-a1b3-5066fb287a9f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:19.716320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:19.717459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:19.717794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:19.718076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] PATH_INFO: `/v3/projects/cd06e9120996451da16d408f4c73b5b5` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:19.719633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd06e9120996451da16d408f4c73b5b5)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:19.722170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:19.812295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd06e9120996451da16d408f4c73b5b5', 'request_id': 'req-f18152b0-312c-491e-bc74-343b3b40a314'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:19.844879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd06e9120996451da16d408f4c73b5b5', 'request_id': 'req-f18152b0-312c-491e-bc74-343b3b40a314'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:19.854240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd06e9120996451da16d408f4c73b5b5', 'request_id': 'req-f18152b0-312c-491e-bc74-343b3b40a314'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:19.882888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] The token cache is being invalidate because project cd06e9120996451da16d408f4c73b5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:19.884376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:19.886743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f18152b0-312c-491e-bc74-343b3b40a314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:19.893496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 844/1691] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:19 2022] DELETE /identity/v3/projects/cd06e9120996451da16d408f4c73b5b5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:19.901224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca535-0ac0-4f68-b05c-d287f1e1d45b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:19.902476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca535-0ac0-4f68-b05c-d287f1e1d45b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:19.903625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca535-0ac0-4f68-b05c-d287f1e1d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:19.972212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c97ca535-0ac0-4f68-b05c-d287f1e1d45b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:19.976380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c97ca535-0ac0-4f68-b05c-d287f1e1d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:20.227660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 848/1692] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:20.236122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce94e-ffbf-406d-9fab-520cda023f8f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:20.237157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce94e-ffbf-406d-9fab-520cda023f8f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:20.237597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce94e-ffbf-406d-9fab-520cda023f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:20.330790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-be9ce94e-ffbf-406d-9fab-520cda023f8f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:20.335737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-be9ce94e-ffbf-406d-9fab-520cda023f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:20.369295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 845/1693] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:20.374164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca535-0ac0-4f68-b05c-d287f1e1d45b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:20.397666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca535-0ac0-4f68-b05c-d287f1e1d45b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:20.430045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2660f2-a09b-4514-bc0e-232cfffc72a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:20.431020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2660f2-a09b-4514-bc0e-232cfffc72a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:20.432228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2660f2-a09b-4514-bc0e-232cfffc72a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:20.433010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2660f2-a09b-4514-bc0e-232cfffc72a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:20.436281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2660f2-a09b-4514-bc0e-232cfffc72a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:20.438186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2660f2-a09b-4514-bc0e-232cfffc72a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:20.448532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2660f2-a09b-4514-bc0e-232cfffc72a0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:20.498765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 849/1694] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:20.500839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ce94e-ffbf-406d-9fab-520cda023f8f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:20.518657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ce94e-ffbf-406d-9fab-520cda023f8f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:20.547596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:20.552515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:20.556700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:20.557007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:20.565012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:20.567132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:20.643092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82834-c9a7-41ad-9630-cd5d024124c8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:20.643389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82834-c9a7-41ad-9630-cd5d024124c8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:20.643673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82834-c9a7-41ad-9630-cd5d024124c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:20.690458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 846/1695] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:20 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:20.692315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-47a82834-c9a7-41ad-9630-cd5d024124c8 None None] MFA Rules not processed for user `9d4785218d704599b5e3481ca05a4b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:20.694711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:20.701854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-47a82834-c9a7-41ad-9630-cd5d024124c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:20.969417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f5bb7-30a8-4691-bd8f-1f85ee74e07c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:20.994045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 850/1696] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:20.994835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:20.995563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:20.995852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:20.996139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:20.996883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:20.999963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:21.064817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 847/1697] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:20 2022] POST /identity/v3/users => generated 284 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:21.065556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82834-c9a7-41ad-9630-cd5d024124c8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:21.084743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82834-c9a7-41ad-9630-cd5d024124c8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:21.089779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:21.090675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:21.090985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:21.091275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:21.092023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:21.104291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:21.156434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 851/1698] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:21.160894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:21.185369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f5b7-155e-41f8-a6d2-67d466c0bc45 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:21.230937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:21.233487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:21.233808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:21.234123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:21.247500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:21.250982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:21.259640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:21.265746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:21.291056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddfe22-2f3a-4612-94b5-d6da215b1456 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:21.303651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:21.307437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 848/1699] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:21.309518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:21.316020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:21.316318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:21.316606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] PATH_INFO: `/v3/users/509ec923609f4f669b73a95747f97dc9` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:21.326866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509ec923609f4f669b73a95747f97dc9)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:21.328906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:21.340762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756ba5-31d8-476b-bd31-6d585d3b8327 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:21.356147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484207c1-3c92-4bcb-8a0d-d4d40feda3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:21.360517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484207c1-3c92-4bcb-8a0d-d4d40feda3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:21.360982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484207c1-3c92-4bcb-8a0d-d4d40feda3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:21.361399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484207c1-3c92-4bcb-8a0d-d4d40feda3f3 admin admin] PATH_INFO: `/v3/projects/8e55c8cdfa504adfb502346a2a9c909c/users/780860a3eb59486cab5c7943915287cb/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:21.411071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484207c1-3c92-4bcb-8a0d-d4d40feda3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e55c8cdfa504adfb502346a2a9c909c, user_id=780860a3eb59486cab5c7943915287cb, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:21.418148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484207c1-3c92-4bcb-8a0d-d4d40feda3f3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:21.460717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509ec923609f4f669b73a95747f97dc9'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:21.467574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509ec923609f4f669b73a95747f97dc9'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:21.480765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 849/1700] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:21 2022] PUT /identity/v3/projects/8e55c8cdfa504adfb502346a2a9c909c/users/780860a3eb59486cab5c7943915287cb/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:21.482399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:21.482693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:21.482968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:21.493490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509ec923609f4f669b73a95747f97dc9'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:21.550343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509ec923609f4f669b73a95747f97dc9'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:21.551244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:21.557525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:21.560301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-19efe25b-4fca-4300-9dd0-a90a3620d431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509ec923609f4f669b73a95747f97dc9'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:21.593450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 852/1701] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:21 2022] DELETE /identity/v3/users/509ec923609f4f669b73a95747f97dc9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:21.598310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:21.598798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:21.599234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:21.648638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:21.651496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:21.756633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 853/1702] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:21.760260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 850/1703] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:21.915535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:21.915739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:21.917151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:21.919546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:22.094044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cf68-6e56-4275-a958-6ce25271d951 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:22.175449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332639-7c06-4824-9ef7-9b4922ed28ea None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:22.186219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d3e6-55af-4389-8a43-f152d1cfae9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:22.188215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d3e6-55af-4389-8a43-f152d1cfae9c service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:22.190989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d3e6-55af-4389-8a43-f152d1cfae9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:22.192065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d3e6-55af-4389-8a43-f152d1cfae9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:22.214642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d3e6-55af-4389-8a43-f152d1cfae9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:22.216187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d3e6-55af-4389-8a43-f152d1cfae9c service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:22.257680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:22.261742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:22.262229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:22.262683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:22.275490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 854/1704] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:22.288939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:22.290709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:22.331599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 851/1705] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:22.383892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d20e7-286c-4c96-82e2-ea0d50571540 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:22.385734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d20e7-286c-4c96-82e2-ea0d50571540 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:22.386719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d20e7-286c-4c96-82e2-ea0d50571540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:22.408459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-345d20e7-286c-4c96-82e2-ea0d50571540 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:22.409963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-345d20e7-286c-4c96-82e2-ea0d50571540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:22.574535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:22.576311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:22.597389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 855/1706] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:22.612202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1a10a-a726-41b3-8fd0-322333e529d7 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:22.628024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:22.628959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:22.629248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:22.629527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] PATH_INFO: `/v3/users/6d055d9ddcb14276a139c92a273b1c17` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:22.636864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d055d9ddcb14276a139c92a273b1c17)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:22.638893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:22.787220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d055d9ddcb14276a139c92a273b1c17'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:22.788892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d055d9ddcb14276a139c92a273b1c17'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:22.808908 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d055d9ddcb14276a139c92a273b1c17'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:22.823160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d055d9ddcb14276a139c92a273b1c17'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:22.835493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d055d9ddcb14276a139c92a273b1c17'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:22.852629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 852/1707] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:22 2022] DELETE /identity/v3/users/6d055d9ddcb14276a139c92a273b1c17 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:22.853074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:22.853552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:22.853823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:22.875894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:22.878568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:22.882855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:22.902086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:22.982351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c49587-409b-44bb-a152-51dfb2fa2633 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:22.991143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:22.992085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:22.992563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:22.994301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:22.996925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:23.070571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 856/1708] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:23.123777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:23.125532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:23.136811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 853/1709] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 18:58:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 18:58:23.239712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:23.241337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:23.382169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2530dd-0c6f-4e8b-ada0-d465ad9f1b15 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:23.391041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d50ab-ac6e-47b5-bf4a-06681e1668cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:23.392014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d50ab-ac6e-47b5-bf4a-06681e1668cd service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:23.392463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d50ab-ac6e-47b5-bf4a-06681e1668cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:23.392934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d50ab-ac6e-47b5-bf4a-06681e1668cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:23.414158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d50ab-ac6e-47b5-bf4a-06681e1668cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:23.416771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d50ab-ac6e-47b5-bf4a-06681e1668cd service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:23.446669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 857/1710] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:25.678000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:25.682386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:25.706123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccf09d-3a97-45b3-be1f-0f3297812582 service swift] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:25.744875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:25.765952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:25.766334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:25.769078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] PATH_INFO: `/v3/projects/31d4c2c179254e91953448f46c6f6ef6` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:25.771478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d4c2c179254e91953448f46c6f6ef6)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:25.773144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:25.896617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d4c2c179254e91953448f46c6f6ef6', 'request_id': 'req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:25.913575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d4c2c179254e91953448f46c6f6ef6', 'request_id': 'req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:25.926864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d4c2c179254e91953448f46c6f6ef6', 'request_id': 'req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:25.969498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] The token cache is being invalidate because project 31d4c2c179254e91953448f46c6f6ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:25.969836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:25.975294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9107a5bd-1ff7-4e57-a04a-6a726832b1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:25.984108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 854/1711] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:25 2022] DELETE /identity/v3/projects/31d4c2c179254e91953448f46c6f6ef6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:25.986347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4cad-669d-4e36-8d2c-438cbaa4aee8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:25.986928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4cad-669d-4e36-8d2c-438cbaa4aee8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:25.987039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4cad-669d-4e36-8d2c-438cbaa4aee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:26.024526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-531d4cad-669d-4e36-8d2c-438cbaa4aee8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:26.026071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-531d4cad-669d-4e36-8d2c-438cbaa4aee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:26.233151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 858/1712] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:26.243137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa79c03-f399-484a-9aa4-5897c209aa48 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:26.243137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa79c03-f399-484a-9aa4-5897c209aa48 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:26.243137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa79c03-f399-484a-9aa4-5897c209aa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:26.342573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-dfa79c03-f399-484a-9aa4-5897c209aa48 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:26.350439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-dfa79c03-f399-484a-9aa4-5897c209aa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:26.377629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 855/1713] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:26.378961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d4cad-669d-4e36-8d2c-438cbaa4aee8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:26.392006 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d4cad-669d-4e36-8d2c-438cbaa4aee8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:26.419526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:26.420284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:26.420934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:26.421473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:26.424925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:26.425407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:26.429404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:26.448993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 859/1714] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:26.453473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa79c03-f399-484a-9aa4-5897c209aa48 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:26.492462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa79c03-f399-484a-9aa4-5897c209aa48 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:26.500977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:26.500977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:26.500977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:26.500977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:26.501652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:26.505831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:26.573375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 856/1715] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:26 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:58:26.578018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:26.592384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfc58b-4b38-4b08-b1c3-413a5dc8eb49 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:26.770861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:26.771544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:26.771830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:26.772104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:26.773335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:26.782048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:26.836927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 860/1716] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:26 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:26.841916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:26.866998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4550-ede1-4127-a697-f594e097436e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:26.893473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:26.894645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:26.895029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:26.895425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:26.896291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:26.898159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:26.948940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:26.950892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 857/1717] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:26.988659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec44e3f-90cf-4e40-bd7f-4bd020049416 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:27.001494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5c98-04bd-4696-9c2b-8167bcf2fb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:27.002889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5c98-04bd-4696-9c2b-8167bcf2fb48 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:27.003333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5c98-04bd-4696-9c2b-8167bcf2fb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:27.003747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5c98-04bd-4696-9c2b-8167bcf2fb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:27.004862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5c98-04bd-4696-9c2b-8167bcf2fb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:27.006646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5c98-04bd-4696-9c2b-8167bcf2fb48 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:27.038528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 861/1718] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:27.043301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:27.073509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74a521-e0d4-4306-bec4-706cd7f01661 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:27.075149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1a86-184d-4c0f-b733-b468a4a38526 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:27.075592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1a86-184d-4c0f-b733-b468a4a38526 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:27.076009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1a86-184d-4c0f-b733-b468a4a38526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:27.081009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fdc70-486f-4663-927e-fbc9ab343759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:27.083071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fdc70-486f-4663-927e-fbc9ab343759 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:27.085838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fdc70-486f-4663-927e-fbc9ab343759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:27.086327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fdc70-486f-4663-927e-fbc9ab343759 admin admin] PATH_INFO: `/v3/projects/01c64d95a9a34eeb9c02e5496bd5c591/users/32aa250c295c460b9f6c212f30d5eb5b/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:27.129953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fdc70-486f-4663-927e-fbc9ab343759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c64d95a9a34eeb9c02e5496bd5c591, user_id=32aa250c295c460b9f6c212f30d5eb5b, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:27.136184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fdc70-486f-4663-927e-fbc9ab343759 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:27.168432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3d2a1a86-184d-4c0f-b733-b468a4a38526 None None] MFA Rules not processed for user `68b1c1f3865042b1bb208cc36b612c55`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:27.179756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3d2a1a86-184d-4c0f-b733-b468a4a38526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:27.186389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 858/1719] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:27 2022] PUT /identity/v3/projects/01c64d95a9a34eeb9c02e5496bd5c591/users/32aa250c295c460b9f6c212f30d5eb5b/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:27.208464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:27.213337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:27.213734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:27.371935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] MFA Rules not processed for user `32aa250c295c460b9f6c212f30d5eb5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:27.373372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:27.499537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 862/1720] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:27.505765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25159fcd-3a35-470c-ad19-6f5831251949 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:27.506284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25159fcd-3a35-470c-ad19-6f5831251949 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:27.506563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25159fcd-3a35-470c-ad19-6f5831251949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:27.569146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-25159fcd-3a35-470c-ad19-6f5831251949 None None] MFA Rules not processed for user `ecc2540fdbe64849b897ae1b7cefe109`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:27.570774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-25159fcd-3a35-470c-ad19-6f5831251949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:27.617341 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 859/1721] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:27.617341 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:27.617341 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:27.777125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 863/1722] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:27.778062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25159fcd-3a35-470c-ad19-6f5831251949 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:27.915813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30c9d8-420b-472a-b2a9-e989492a5e9e None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:27.944834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:27.945769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:27.947127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:27.947549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:27.959408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25159fcd-3a35-470c-ad19-6f5831251949 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:27.965244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:27.966240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:27.966671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:27.967130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:27.968292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:27.970640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:27.972554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:27.986350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:28.012023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 864/1723] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:27 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:28.016766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:28.019208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 860/1724] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:28.147611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:28.163635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c249e4-f041-4690-a30e-679f87d6683d service nova] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:28.265610 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694b7f6-3e91-41b1-8659-cd9da3d16b1d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:28.279696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:28.281153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:28.281448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:28.281896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:28.282803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:28.288539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:28.326226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9e514-b408-4cf3-8181-4d19f838eaaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:28.330878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9e514-b408-4cf3-8181-4d19f838eaaf service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:28.332512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9e514-b408-4cf3-8181-4d19f838eaaf service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:28.333794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9e514-b408-4cf3-8181-4d19f838eaaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:28.342673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 865/1725] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:28 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:28.347282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:28.379576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e346197-4260-42f8-a9ab-765e96ebdbf6 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:28.386976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:28.387796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:28.388200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:28.388767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:28.389834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:28.393182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:28.411654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 866/1726] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:28.417186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:28.448291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f0d2-5ad5-45e4-b6c2-c04a77872c22 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:28.463716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d880-a1c3-4db3-9d05-3c7214ddd33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:28.465176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d880-a1c3-4db3-9d05-3c7214ddd33f admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:28.465360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d880-a1c3-4db3-9d05-3c7214ddd33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:28.465659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d880-a1c3-4db3-9d05-3c7214ddd33f admin admin] PATH_INFO: `/v3/projects/c07daeadf886436f8ab335aecf000283/users/60267613a7f0465ca318d1e308b1b001/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:28.507281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9e514-b408-4cf3-8181-4d19f838eaaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:28.509086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9e514-b408-4cf3-8181-4d19f838eaaf service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:28.514030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d880-a1c3-4db3-9d05-3c7214ddd33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07daeadf886436f8ab335aecf000283, user_id=60267613a7f0465ca318d1e308b1b001, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:28.517548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d880-a1c3-4db3-9d05-3c7214ddd33f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:28.532278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 861/1727] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:28.536225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bab2e-0592-4d97-b1cc-d170cce5dc83 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:28.536541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bab2e-0592-4d97-b1cc-d170cce5dc83 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:28.538316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bab2e-0592-4d97-b1cc-d170cce5dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:28.544447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 867/1728] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:28 2022] PUT /identity/v3/projects/c07daeadf886436f8ab335aecf000283/users/60267613a7f0465ca318d1e308b1b001/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:28.545853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c325-8907-4b0a-8671-313b49699b7c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:28.546188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c325-8907-4b0a-8671-313b49699b7c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:28.546471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c325-8907-4b0a-8671-313b49699b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:28.583183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ea8bab2e-0592-4d97-b1cc-d170cce5dc83 None None] MFA Rules not processed for user `945283f83c1b4ee0a1a59b0732090fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:28.584438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ea8bab2e-0592-4d97-b1cc-d170cce5dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:28.607116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1b87c325-8907-4b0a-8671-313b49699b7c None None] MFA Rules not processed for user `a1ccfbe59f4841a093c71c75585fb2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:28.608384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1b87c325-8907-4b0a-8671-313b49699b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:28.785642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 862/1729] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 10 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:28.789826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bab2e-0592-4d97-b1cc-d170cce5dc83 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:28.796494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 868/1730] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:28.812803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:28.817609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:28.818079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:28.903553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] MFA Rules not processed for user `780860a3eb59486cab5c7943915287cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:28.905021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:29.084739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bab2e-0592-4d97-b1cc-d170cce5dc83 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.091539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.092246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.092772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.093377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.093645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 869/1731] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:29.094199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.094829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:29.095941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.098800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:29.119193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 863/1732] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:29.123759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:29.128897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba7f8-183c-4dfc-b92b-3925f8eba16a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.138155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.139036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.139422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.139804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.162973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.163715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552cc8-a8e0-467f-85e2-746bc5dc5138 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.165875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.171830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.178293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.178293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.178293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.193440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 870/1733] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:29.194821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:29.198416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:29.198641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.200165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.219235 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 864/1734] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:29.221560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:29.226654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a468-4f19-4946-b391-d9dcd0f9bac0 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.233692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d027df-d2ee-46f8-9b8f-8d10559fb40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.234716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d027df-d2ee-46f8-9b8f-8d10559fb40a admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.235210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d027df-d2ee-46f8-9b8f-8d10559fb40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.235684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d027df-d2ee-46f8-9b8f-8d10559fb40a admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.236639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d027df-d2ee-46f8-9b8f-8d10559fb40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.238811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d027df-d2ee-46f8-9b8f-8d10559fb40a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.250989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3cf6d-94da-4382-aafa-dd714b672de4 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.258979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.259950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.265345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.266440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] PATH_INFO: `/v3/projects/c07daeadf886436f8ab335aecf000283/users/60267613a7f0465ca318d1e308b1b001/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.285062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07daeadf886436f8ab335aecf000283, user_id=60267613a7f0465ca318d1e308b1b001, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.290822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.318707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 871/1735] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:29 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:29.321540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 865/1736] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:29 2022] PUT /identity/v3/projects/c07daeadf886436f8ab335aecf000283/users/60267613a7f0465ca318d1e308b1b001/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:29.333423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:29.333658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.333767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.334402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.390035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] MFA Rules not processed for user `60267613a7f0465ca318d1e308b1b001`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:29.391329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:29.541898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f5ee-03e1-4146-b5cb-57eed8ee1d47 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.552688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 872/1737] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:29.558028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:29.560578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:29.708481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.709306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.709787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.710087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.711028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.713442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.774999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 866/1738] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:29 2022] POST /identity/v3/users => generated 292 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:29.777007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:29.782036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:29.823628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1f66-d121-4a63-853f-d1d02269f38e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.853278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.854188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.854473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.854756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] PATH_INFO: `/v3/projects/61b421176f834b27b365622111b2e4ab` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.861363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b421176f834b27b365622111b2e4ab)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.863497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.902473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb80201-b9e0-435b-9ceb-b8b4c52389d2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:29.926228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:29.927796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:29.927796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:29.927796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:29.975485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:29.982313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:29.989257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b421176f834b27b365622111b2e4ab', 'request_id': 'req-cf2402d7-1031-430a-bf1d-bbe39a9d4334'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.005617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b421176f834b27b365622111b2e4ab', 'request_id': 'req-cf2402d7-1031-430a-bf1d-bbe39a9d4334'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.027746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 867/1739] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:30.028148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b421176f834b27b365622111b2e4ab', 'request_id': 'req-cf2402d7-1031-430a-bf1d-bbe39a9d4334'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.029490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:30.040033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] The token cache is being invalidate because project 61b421176f834b27b365622111b2e4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:30.040235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.045238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.047518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 873/1740] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:29 2022] DELETE /identity/v3/projects/61b421176f834b27b365622111b2e4ab => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:30.051352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:30.054219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:30.057844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc796-6ef9-4a3e-95a7-6126d01386df service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:30.188447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2402d7-1031-430a-bf1d-bbe39a9d4334 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:30.194071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:30.195264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:30.195592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:30.195966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] PATH_INFO: `/v3/users/f9c1bb11f71545dcbeaf7a321d031a22` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:30.202880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c1bb11f71545dcbeaf7a321d031a22)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:30.205070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:30.206418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:30.207256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:30.207540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:30.207869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:30.208669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:30.212835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:30.240799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 868/1741] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:30.241856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:30.251161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:30.287542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c1bb11f71545dcbeaf7a321d031a22'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.289264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c1bb11f71545dcbeaf7a321d031a22'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.320068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c1bb11f71545dcbeaf7a321d031a22'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.348168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c1bb11f71545dcbeaf7a321d031a22'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.372147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c1bb11f71545dcbeaf7a321d031a22'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:30.391998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64101db7-52fa-4bd2-87a8-1e0fa5a21e6f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:30.392156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 874/1742] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:30 2022] DELETE /identity/v3/users/f9c1bb11f71545dcbeaf7a321d031a22 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:30.392156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:30.404386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:30.469943 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:30.470693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:30.471101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:30.471375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:30.473417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:30.588972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de0a5-94a1-486a-935e-f4c138e51dcc admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:30.602681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:30.603797 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:30.604076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:30.604351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] PATH_INFO: `/v3/projects/c0fadc7d6f14426c9859b261b1444fd4/users/76b85778d788446b834b04e607c80e12/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:30.614076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:30.618531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:30.642439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fadc7d6f14426c9859b261b1444fd4, user_id=76b85778d788446b834b04e607c80e12, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:30.644177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 869/1743] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:30.646920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:30.668095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 875/1744] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:30 2022] PUT /identity/v3/projects/c0fadc7d6f14426c9859b261b1444fd4/users/76b85778d788446b834b04e607c80e12/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:30.673881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:30.688972 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b6314-cf27-459e-bf86-e5c180f7fdc3 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:30.869459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615c8be-d4f6-4253-b678-341a72eefb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:30.872905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c8be-d4f6-4253-b678-341a72eefb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:30.874654 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c8be-d4f6-4253-b678-341a72eefb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:30.875840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c8be-d4f6-4253-b678-341a72eefb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:30.879826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615c8be-d4f6-4253-b678-341a72eefb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:30.890563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615c8be-d4f6-4253-b678-341a72eefb5a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:30.934733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 870/1745] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:30.938721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:30.964446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f555c-703b-4b0c-848c-d35bff3108f4 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:30.987445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9cfb5-3ffc-4878-8d21-da152015ae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:30.992879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9cfb5-3ffc-4878-8d21-da152015ae15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:30.992879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9cfb5-3ffc-4878-8d21-da152015ae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:30.992879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9cfb5-3ffc-4878-8d21-da152015ae15 admin admin] PATH_INFO: `/v3/projects/c0fadc7d6f14426c9859b261b1444fd4/users/76b85778d788446b834b04e607c80e12/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:31.002793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9cfb5-3ffc-4878-8d21-da152015ae15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fadc7d6f14426c9859b261b1444fd4, user_id=76b85778d788446b834b04e607c80e12, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:31.011076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9cfb5-3ffc-4878-8d21-da152015ae15 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:31.045671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 876/1746] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:30 2022] PUT /identity/v3/projects/c0fadc7d6f14426c9859b261b1444fd4/users/76b85778d788446b834b04e607c80e12/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:33.778276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8156-94cc-4b56-84cb-f3fa08268bd4 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:33.779203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8156-94cc-4b56-84cb-f3fa08268bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:33.779703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8156-94cc-4b56-84cb-f3fa08268bd4 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:33.782338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 871/1747] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 18:58:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:34.239813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:34.241128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:34.241683 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:34.295941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:34.298765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:34.503617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 877/1748] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 18:58:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:35.291350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f8156-94cc-4b56-84cb-f3fa08268bd4 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:35.293942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ca3f8156-94cc-4b56-84cb-f3fa08268bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:35.352943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:35.361060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:35.454831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f8156-94cc-4b56-84cb-f3fa08268bd4 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:35.491850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1627c6-bb0f-4369-87df-74fdac76deae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:35.503319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1627c6-bb0f-4369-87df-74fdac76deae service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:35.503789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1627c6-bb0f-4369-87df-74fdac76deae service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:35.504001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1627c6-bb0f-4369-87df-74fdac76deae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:35.563162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1627c6-bb0f-4369-87df-74fdac76deae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:35.566597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1627c6-bb0f-4369-87df-74fdac76deae service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:35.599893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65150f-6eb8-4778-949e-68eec1a9d72d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:35.611219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 872/1749] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:35.612850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:35.615362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:35.615764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:35.626034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:35.627733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:35.628214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:35.628651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] PATH_INFO: `/v3/projects/d5b7938a44f040d2adbe1890e52eea86` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:35.632482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b7938a44f040d2adbe1890e52eea86)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:35.640138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:35.716891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] MFA Rules not processed for user `76b85778d788446b834b04e607c80e12`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:35.718312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:35.758879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b7938a44f040d2adbe1890e52eea86', 'request_id': 'req-84dceadb-742c-41c5-a453-04abc2b2b7c1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:35.784595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b7938a44f040d2adbe1890e52eea86', 'request_id': 'req-84dceadb-742c-41c5-a453-04abc2b2b7c1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:35.796707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b7938a44f040d2adbe1890e52eea86', 'request_id': 'req-84dceadb-742c-41c5-a453-04abc2b2b7c1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:35.846483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 873/1750] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:35.859834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] The token cache is being invalidate because project d5b7938a44f040d2adbe1890e52eea86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:35.860496 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:35.861080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:35.863547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:35.864170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-84dceadb-742c-41c5-a453-04abc2b2b7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:35.872202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 878/1751] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:35 2022] DELETE /identity/v3/projects/d5b7938a44f040d2adbe1890e52eea86 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:35.892969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9bba-af61-4604-ac00-8c35c239198a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:35.893259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9bba-af61-4604-ac00-8c35c239198a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:35.893546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9bba-af61-4604-ac00-8c35c239198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:35.981526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-49ab9bba-af61-4604-ac00-8c35c239198a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:35.986321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-49ab9bba-af61-4604-ac00-8c35c239198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:36.006277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686272c-7673-48db-b28b-f5b1c5b47603 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:36.076785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cf216-c2fa-48f6-8c8c-32710232b46a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:36.078780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cf216-c2fa-48f6-8c8c-32710232b46a service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.079326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cf216-c2fa-48f6-8c8c-32710232b46a service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.080573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cf216-c2fa-48f6-8c8c-32710232b46a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.083613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-852cf216-c2fa-48f6-8c8c-32710232b46a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:36.162007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 879/1752] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:36.163441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc908fa-ddc3-42ea-bbc7-66f611391c27 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.163903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc908fa-ddc3-42ea-bbc7-66f611391c27 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.164085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc908fa-ddc3-42ea-bbc7-66f611391c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.201018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4bc908fa-ddc3-42ea-bbc7-66f611391c27 None None] MFA Rules not processed for user `68b1c1f3865042b1bb208cc36b612c55`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:36.202259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4bc908fa-ddc3-42ea-bbc7-66f611391c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:36.249909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cf216-c2fa-48f6-8c8c-32710232b46a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:36.263078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cf216-c2fa-48f6-8c8c-32710232b46a service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:36.281866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 874/1753] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:36.286032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330cab-eb49-4a17-919c-9f427cd00f63 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.286032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330cab-eb49-4a17-919c-9f427cd00f63 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.286032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330cab-eb49-4a17-919c-9f427cd00f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.309622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f0330cab-eb49-4a17-919c-9f427cd00f63 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:36.311339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f0330cab-eb49-4a17-919c-9f427cd00f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:36.325232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 875/1754] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:36.326319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0330cab-eb49-4a17-919c-9f427cd00f63 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:36.345792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0330cab-eb49-4a17-919c-9f427cd00f63 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:36.351448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:36.352164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.352548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.352981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.354004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:36.354416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:36.357226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:36.377764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 876/1755] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:36.377953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 880/1756] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:36.382320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:36.394549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a720d43-6996-4d5b-bd76-49de829fb87c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:36.399927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:36.400823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.401209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.402577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.403096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:36.407514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:36.468248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 877/1757] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:36 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:36.474741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc908fa-ddc3-42ea-bbc7-66f611391c27 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:36.512718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc908fa-ddc3-42ea-bbc7-66f611391c27 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:36.599906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:36.601969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.603184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.603633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.606066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:36.610652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:36.668903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 881/1758] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:36 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:36.669876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:36.687524 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283996b1-d5a3-4b50-9e5a-d936f92189a6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:36.694977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304b5c0-9521-4eb2-ac91-8c602df713ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:36.697260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304b5c0-9521-4eb2-ac91-8c602df713ec admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.697655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304b5c0-9521-4eb2-ac91-8c602df713ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.697953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304b5c0-9521-4eb2-ac91-8c602df713ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.710277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304b5c0-9521-4eb2-ac91-8c602df713ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:36.713328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304b5c0-9521-4eb2-ac91-8c602df713ec admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:36.744730 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:36.772331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 878/1759] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:36.777980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e8a94-b12e-46fd-9dfd-9d80f7fc9d99 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:36.785087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:36.788079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5bea-f100-4b56-a323-5a855e71d377 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.788587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5bea-f100-4b56-a323-5a855e71d377 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.790646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5bea-f100-4b56-a323-5a855e71d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.799729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.801464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.807108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.809493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:36.813535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:36.840471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-37bf5bea-f100-4b56-a323-5a855e71d377 None None] MFA Rules not processed for user `ecc2540fdbe64849b897ae1b7cefe109`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:36.843866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-37bf5bea-f100-4b56-a323-5a855e71d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:36.852953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 882/1760] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:36.855174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:36.889820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0de0-8c13-4949-8a24-de4d211071da admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:36.910348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68175f-7987-470a-bb5c-2fe92c788b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:36.911273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68175f-7987-470a-bb5c-2fe92c788b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:36.911554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68175f-7987-470a-bb5c-2fe92c788b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:36.911941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68175f-7987-470a-bb5c-2fe92c788b2c admin admin] PATH_INFO: `/v3/projects/020dbe263206433982526af0d1c737fe/users/88e2c72dd0f546bc9438852c4f59d34f/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:36.954209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68175f-7987-470a-bb5c-2fe92c788b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=020dbe263206433982526af0d1c737fe, user_id=88e2c72dd0f546bc9438852c4f59d34f, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:36.965153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68175f-7987-470a-bb5c-2fe92c788b2c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:37.004794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 883/1761] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:36 2022] PUT /identity/v3/projects/020dbe263206433982526af0d1c737fe/users/88e2c72dd0f546bc9438852c4f59d34f/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:37.010902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 879/1762] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:37.015274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467d93-92aa-4f4a-a4a9-2f2698426465 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:37.015572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467d93-92aa-4f4a-a4a9-2f2698426465 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:37.015898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467d93-92aa-4f4a-a4a9-2f2698426465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:37.090872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-12467d93-92aa-4f4a-a4a9-2f2698426465 None None] MFA Rules not processed for user `88e2c72dd0f546bc9438852c4f59d34f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:37.092009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-12467d93-92aa-4f4a-a4a9-2f2698426465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:37.235796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 884/1763] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:37.241115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5bea-f100-4b56-a323-5a855e71d377 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:37.252417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5bea-f100-4b56-a323-5a855e71d377 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:37.389829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:37.390686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:37.391205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:37.391701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:37.392762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:37.396736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:37.439258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 880/1764] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:37 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:37.443121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12467d93-92aa-4f4a-a4a9-2f2698426465 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:37.457126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12467d93-92aa-4f4a-a4a9-2f2698426465 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:37.534277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:37.535389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:37.535834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:37.536167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:37.538165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:37.540970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:37.581644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 885/1765] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:37 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:37.583746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:37.614222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23779-6f55-4635-bf6d-03e867becb46 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:37.645499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:37.646207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:37.650469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:37.653319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:37.654425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:37.671972 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:37.699415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:37.709138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 881/1766] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:37.713154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314c3b2-52b9-4ead-995a-f783006f1ad3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:37.721323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:37.723510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:37.724158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:37.725117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] PATH_INFO: `/v3/projects/587cc400f5ba4f628a5861583dbe9018/users/7d39e1e94948402fb4ce9657890be114/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:37.756528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] RBAC: Authorizing `identity:create_grant(project_id=587cc400f5ba4f628a5861583dbe9018, user_id=7d39e1e94948402fb4ce9657890be114, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:37.765632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:37.804250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:37.813085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 886/1767] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:37 2022] PUT /identity/v3/projects/587cc400f5ba4f628a5861583dbe9018/users/7d39e1e94948402fb4ce9657890be114/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:37.820787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772d69-062b-4378-a60e-65782d155704 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:37.979775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd8e3d-6f86-4f26-8754-ca72456b1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:37.980944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8e3d-6f86-4f26-8754-ca72456b1990 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:37.981434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8e3d-6f86-4f26-8754-ca72456b1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:37.981927 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8e3d-6f86-4f26-8754-ca72456b1990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:37.982962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd8e3d-6f86-4f26-8754-ca72456b1990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:37.985269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd8e3d-6f86-4f26-8754-ca72456b1990 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:38.012003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 882/1768] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:38.016390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:38.031712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0e4aa-ce27-4806-855c-a461ff0411da admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:38.044026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:38.044864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:38.045152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:38.045432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] PATH_INFO: `/v3/projects/587cc400f5ba4f628a5861583dbe9018/users/7d39e1e94948402fb4ce9657890be114/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:38.049774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=587cc400f5ba4f628a5861583dbe9018, user_id=7d39e1e94948402fb4ce9657890be114, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:38.064891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:38.087911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 887/1769] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:38 2022] PUT /identity/v3/projects/587cc400f5ba4f628a5861583dbe9018/users/7d39e1e94948402fb4ce9657890be114/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:38.089443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8a4fb-658d-4e3a-976d-3d340f6d2a23 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:38.089734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8a4fb-658d-4e3a-976d-3d340f6d2a23 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:38.090012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8a4fb-658d-4e3a-976d-3d340f6d2a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:38.171011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7dd8a4fb-658d-4e3a-976d-3d340f6d2a23 None None] MFA Rules not processed for user `7d39e1e94948402fb4ce9657890be114`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:38.174297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7dd8a4fb-658d-4e3a-976d-3d340f6d2a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:38.313731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 883/1770] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:38.323819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:38.327434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:38.567725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f5aaa-4f93-437a-a37d-3c3a1b293873 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:38.587010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48732af2-9674-41fa-a7b0-660ac7b58c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:38.589917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48732af2-9674-41fa-a7b0-660ac7b58c02 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:38.594718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48732af2-9674-41fa-a7b0-660ac7b58c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:38.599728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48732af2-9674-41fa-a7b0-660ac7b58c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:38.655744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48732af2-9674-41fa-a7b0-660ac7b58c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:38.657289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48732af2-9674-41fa-a7b0-660ac7b58c02 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:38.677107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 888/1771] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:39.305231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8a4fb-658d-4e3a-976d-3d340f6d2a23 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:39.323714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8a4fb-658d-4e3a-976d-3d340f6d2a23 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:39.332877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66445c-22b7-4c31-8c6d-c4fab9ca4a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:39.333632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66445c-22b7-4c31-8c6d-c4fab9ca4a2f service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:39.334093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66445c-22b7-4c31-8c6d-c4fab9ca4a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:39.334520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66445c-22b7-4c31-8c6d-c4fab9ca4a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:39.340095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4f66445c-22b7-4c31-8c6d-c4fab9ca4a2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:39.615476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66445c-22b7-4c31-8c6d-c4fab9ca4a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:39.616969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66445c-22b7-4c31-8c6d-c4fab9ca4a2f service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:39.662097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 884/1772] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:41.478578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf06e7-d875-44ef-8402-2a844d253ecf None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:41.479123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf06e7-d875-44ef-8402-2a844d253ecf None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:41.480832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf06e7-d875-44ef-8402-2a844d253ecf None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:41.482667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 889/1773] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 18:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:41.493745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:41.494652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:41.495212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:41.533361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:41.534841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:41.719348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 885/1774] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:42.086634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf06e7-d875-44ef-8402-2a844d253ecf None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:42.202808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf06e7-d875-44ef-8402-2a844d253ecf None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:42.220163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:42.223973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:42.225215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:42.225705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] PATH_INFO: `/v3/users/88e2c72dd0f546bc9438852c4f59d34f` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:42.232188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:42.236232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:42.247646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e2c72dd0f546bc9438852c4f59d34f)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:42.250944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:42.258985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070c2-cce0-47c9-817a-9caf704abad2 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:42.273730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581421dd-5d03-488e-ab22-dba85f66871a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:42.274918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581421dd-5d03-488e-ab22-dba85f66871a service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:42.277739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581421dd-5d03-488e-ab22-dba85f66871a service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:42.278239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581421dd-5d03-488e-ab22-dba85f66871a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:42.301144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581421dd-5d03-488e-ab22-dba85f66871a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:42.304367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581421dd-5d03-488e-ab22-dba85f66871a service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:42.319403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 886/1775] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:42.347698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e2c72dd0f546bc9438852c4f59d34f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:42.348381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e2c72dd0f546bc9438852c4f59d34f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:42.360105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e2c72dd0f546bc9438852c4f59d34f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:42.381338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e2c72dd0f546bc9438852c4f59d34f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:42.391842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e2c72dd0f546bc9438852c4f59d34f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:42.400668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 890/1776] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:42 2022] DELETE /identity/v3/users/88e2c72dd0f546bc9438852c4f59d34f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:42.405105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020064-2013-4174-870c-76ca60d0415c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:42.405399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020064-2013-4174-870c-76ca60d0415c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:42.405679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020064-2013-4174-870c-76ca60d0415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:42.437028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-74020064-2013-4174-870c-76ca60d0415c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:42.438694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-74020064-2013-4174-870c-76ca60d0415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:42.516354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 887/1777] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:42.529306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:42.531000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:42.600391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913f96-1689-4eab-b884-1fba2b6ff880 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:42.604953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:42.605709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:42.606077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:42.606421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:42.616712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:42.618295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:42.629479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 891/1778] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:58:43.096347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020064-2013-4174-870c-76ca60d0415c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:43.098412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-74020064-2013-4174-870c-76ca60d0415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:43.133879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020064-2013-4174-870c-76ca60d0415c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:43.148297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:43.149506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:43.149945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:43.150494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] PATH_INFO: `/v3/projects/020dbe263206433982526af0d1c737fe` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:43.152530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] RBAC: Authorizing `identity:delete_project(project_id=020dbe263206433982526af0d1c737fe)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:43.175903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:43.264925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020dbe263206433982526af0d1c737fe', 'request_id': 'req-e0c66932-d6e3-4e07-b6b8-cd157e9781be'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.285361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020dbe263206433982526af0d1c737fe', 'request_id': 'req-e0c66932-d6e3-4e07-b6b8-cd157e9781be'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.294525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020dbe263206433982526af0d1c737fe', 'request_id': 'req-e0c66932-d6e3-4e07-b6b8-cd157e9781be'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.309918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] The token cache is being invalidate because project 020dbe263206433982526af0d1c737fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:43.310615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.311647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.314152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 888/1779] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:43 2022] DELETE /identity/v3/projects/020dbe263206433982526af0d1c737fe => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:43.317912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:43.330037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102a68-2fd3-4d5d-9e07-7712b2403ff9 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:43.451975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:43.453303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:43.453720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:43.454142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] PATH_INFO: `/v3/users/7d39e1e94948402fb4ce9657890be114` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:43.456160 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d39e1e94948402fb4ce9657890be114)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:43.458964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:43.541117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d39e1e94948402fb4ce9657890be114'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.545093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d39e1e94948402fb4ce9657890be114'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.565554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d39e1e94948402fb4ce9657890be114'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.586350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d39e1e94948402fb4ce9657890be114'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.594760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea892596-9983-4f09-b9f3-2822d4228b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d39e1e94948402fb4ce9657890be114'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.623033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 892/1780] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:43 2022] DELETE /identity/v3/users/7d39e1e94948402fb4ce9657890be114 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:43.692702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:43.695832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:43.712437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66932-d6e3-4e07-b6b8-cd157e9781be admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:43.810516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:43.813268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:43.813842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:43.814938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] PATH_INFO: `/v3/users/32aa250c295c460b9f6c212f30d5eb5b` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:43.822652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32aa250c295c460b9f6c212f30d5eb5b)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:43.825164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:43.880145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32aa250c295c460b9f6c212f30d5eb5b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.881121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32aa250c295c460b9f6c212f30d5eb5b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.892916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32aa250c295c460b9f6c212f30d5eb5b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.902074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32aa250c295c460b9f6c212f30d5eb5b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.910353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32aa250c295c460b9f6c212f30d5eb5b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:43.918144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 889/1781] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:43 2022] DELETE /identity/v3/users/32aa250c295c460b9f6c212f30d5eb5b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:43.922797 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:43.923417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:43.923880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:43.950484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:43.951825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:44.026415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 893/1782] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:44.101698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:44.104490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:44.207938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0efd3-2244-4bf9-8fce-099b816f250b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:44.214052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34f982-0946-4909-8bf9-7bef5d13c140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:44.215318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f982-0946-4909-8bf9-7bef5d13c140 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:44.216049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f982-0946-4909-8bf9-7bef5d13c140 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:44.216850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34f982-0946-4909-8bf9-7bef5d13c140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:44.240659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34f982-0946-4909-8bf9-7bef5d13c140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:44.241860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34f982-0946-4909-8bf9-7bef5d13c140 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:44.264626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 890/1783] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:45.542193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:45.547665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:45.572357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb8436-ed6c-4b67-9117-d9ee9f7cb6f3 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:45.601309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:45.602325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:45.602717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:45.603162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] PATH_INFO: `/v3/projects/587cc400f5ba4f628a5861583dbe9018` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:45.604632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] RBAC: Authorizing `identity:delete_project(project_id=587cc400f5ba4f628a5861583dbe9018)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:45.607389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:45.719708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587cc400f5ba4f628a5861583dbe9018', 'request_id': 'req-cab7aad6-2f97-4e5b-95f1-1077f290950f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:45.749806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587cc400f5ba4f628a5861583dbe9018', 'request_id': 'req-cab7aad6-2f97-4e5b-95f1-1077f290950f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:45.760785 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587cc400f5ba4f628a5861583dbe9018', 'request_id': 'req-cab7aad6-2f97-4e5b-95f1-1077f290950f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:45.777767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] The token cache is being invalidate because project 587cc400f5ba4f628a5861583dbe9018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:45.778405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:45.780114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:45.788084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 894/1784] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:45 2022] DELETE /identity/v3/projects/587cc400f5ba4f628a5861583dbe9018 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:45.792897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea082c3-6c8c-458a-bed6-0e30b7ee8141 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:45.793465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea082c3-6c8c-458a-bed6-0e30b7ee8141 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:45.793465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea082c3-6c8c-458a-bed6-0e30b7ee8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:45.824867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9ea082c3-6c8c-458a-bed6-0e30b7ee8141 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:45.826907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9ea082c3-6c8c-458a-bed6-0e30b7ee8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:46.052603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.056194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:46.080000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7aad6-2f97-4e5b-95f1-1077f290950f admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:46.082097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 891/1785] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:46.089650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5388e4-6d36-4f8a-912c-61a2fbee880f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.090146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5388e4-6d36-4f8a-912c-61a2fbee880f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.090586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5388e4-6d36-4f8a-912c-61a2fbee880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.100141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:46.101073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.101425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.101595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] PATH_INFO: `/v3/projects/01c64d95a9a34eeb9c02e5496bd5c591` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.106592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c64d95a9a34eeb9c02e5496bd5c591)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:46.108526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:46.121580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-cd5388e4-6d36-4f8a-912c-61a2fbee880f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:46.125266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-cd5388e4-6d36-4f8a-912c-61a2fbee880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:46.145591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 892/1786] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:46.149863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5388e4-6d36-4f8a-912c-61a2fbee880f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.180151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5388e4-6d36-4f8a-912c-61a2fbee880f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:46.195705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:46.196401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.196705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.196988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.197735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:46.198044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:46.199660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:46.215842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c64d95a9a34eeb9c02e5496bd5c591', 'request_id': 'req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.226235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c64d95a9a34eeb9c02e5496bd5c591', 'request_id': 'req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.232062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 893/1787] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:58:46.236853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.237167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c64d95a9a34eeb9c02e5496bd5c591', 'request_id': 'req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.255462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601d813-0da1-4d7f-a951-c243544b8f5e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:46.258538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] The token cache is being invalidate because project 01c64d95a9a34eeb9c02e5496bd5c591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:46.258880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.267362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.296365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 895/1788] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:46 2022] DELETE /identity/v3/projects/01c64d95a9a34eeb9c02e5496bd5c591 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:46.301295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.303274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:46.387347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:46.388051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.388336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.388616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.389514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:46.391309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:46.488014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 894/1789] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:46 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:58:46.495092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.498415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:46.532797 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd4621-c8ff-4c4f-b4a9-2e28fabdf4d7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:46.653388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:46.655106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.655543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.658028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] PATH_INFO: `/v3/users/60267613a7f0465ca318d1e308b1b001` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.659376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51f13-6d0d-4b6d-be39-b6c139db9300 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:46.660252 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60267613a7f0465ca318d1e308b1b001)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:46.665617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:46.671297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:46.673202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.675458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.675925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.677794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:46.684600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:46.731933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 895/1790] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:46 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:58:46.736440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.752774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70760e59-0bfc-40c1-aaad-07f5b3564190 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:46.759404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:46.760439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.760959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.761431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.763422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:46.767293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:46.783286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 896/1791] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:46.787778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.800755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60267613a7f0465ca318d1e308b1b001'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.803518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60267613a7f0465ca318d1e308b1b001'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.803751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150206c9-29b6-4c1d-b39c-1956a9260754 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:46.813091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:46.814362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:46.814879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:46.815545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:46.816596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:46.819842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:46.822886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60267613a7f0465ca318d1e308b1b001'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.852593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60267613a7f0465ca318d1e308b1b001'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.868662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 897/1792] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:46.873075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:46.874349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e74015be-840d-42fd-9793-e8fc20b60632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60267613a7f0465ca318d1e308b1b001'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:46.875502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:46.893552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 896/1793] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:46 2022] DELETE /identity/v3/users/60267613a7f0465ca318d1e308b1b001 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:46.899318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab18c4-9b36-4ef8-a6d4-721ab111b840 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:47.146821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdcc31-8b77-41c6-8459-435f2b61f42b None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.147115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdcc31-8b77-41c6-8459-435f2b61f42b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.147529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdcc31-8b77-41c6-8459-435f2b61f42b None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.149069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 897/1794] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 18:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 18:58:47.165161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12576-f3cd-4b68-8fe5-318235164fef None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.165479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12576-f3cd-4b68-8fe5-318235164fef None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.165711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12576-f3cd-4b68-8fe5-318235164fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.199419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a560c-6ba4-4200-af77-5e3e65c284bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:47.201229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a560c-6ba4-4200-af77-5e3e65c284bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.201509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a560c-6ba4-4200-af77-5e3e65c284bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.203933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a560c-6ba4-4200-af77-5e3e65c284bf admin admin] PATH_INFO: `/v3/projects/01960e19a1e64f0798b5618652d9ef7a/users/9a122a207434429b9a075894ae062a06/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.204656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-56e12576-f3cd-4b68-8fe5-318235164fef None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:47.205962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-56e12576-f3cd-4b68-8fe5-318235164fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:47.232703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a560c-6ba4-4200-af77-5e3e65c284bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01960e19a1e64f0798b5618652d9ef7a, user_id=9a122a207434429b9a075894ae062a06, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:47.236427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a560c-6ba4-4200-af77-5e3e65c284bf admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:47.258919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 898/1795] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:46 2022] PUT /identity/v3/projects/01960e19a1e64f0798b5618652d9ef7a/users/9a122a207434429b9a075894ae062a06/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:47.269970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdeb74-0afd-458b-a3c4-3c93aa7fa1a1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.270885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdeb74-0afd-458b-a3c4-3c93aa7fa1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.271370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdeb74-0afd-458b-a3c4-3c93aa7fa1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.337680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-36bdeb74-0afd-458b-a3c4-3c93aa7fa1a1 None None] MFA Rules not processed for user `9a122a207434429b9a075894ae062a06`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:47.340045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-36bdeb74-0afd-458b-a3c4-3c93aa7fa1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:47.375504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 898/1796] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 18:58:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:47.458017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 899/1797] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:47.463843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12576-f3cd-4b68-8fe5-318235164fef None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:47.491706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12576-f3cd-4b68-8fe5-318235164fef None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:47.633741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:47.635280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.635825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.636239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.637123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:47.639170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:47.689334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 899/1798] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:47 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:47.693400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdeb74-0afd-458b-a3c4-3c93aa7fa1a1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:47.709834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdeb74-0afd-458b-a3c4-3c93aa7fa1a1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:47.730978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:47.738156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:47.834434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:47.836193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.837383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.837985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.839517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:47.842734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:47.873620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 900/1799] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:47 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:47.882805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:47.898307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1b562-09b1-45a6-b884-a7164f5d7ea0 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:47.909612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:47.910301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.910578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.910855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.924919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0e88-5b4d-44a8-bf5a-ed6b6368f761 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:47.934517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:47.935522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:47.935848 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:47.936265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:47.937941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:47.939991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:47.941912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:47.943738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:47.966751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 901/1800] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:47.969062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 900/1801] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:47.970289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:47.992514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc83af0-06d2-4d38-96f1-a7e39858b39a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:48.006025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0371ab-1cdc-4ecb-9dc4-a867b028cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:48.006722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0371ab-1cdc-4ecb-9dc4-a867b028cb15 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:48.007003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0371ab-1cdc-4ecb-9dc4-a867b028cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:48.007274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0371ab-1cdc-4ecb-9dc4-a867b028cb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:48.008015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0371ab-1cdc-4ecb-9dc4-a867b028cb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:48.009766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0371ab-1cdc-4ecb-9dc4-a867b028cb15 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:48.045275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 902/1802] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:48.049194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:48.061650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d03bc-6b8d-4fff-b7fd-1a7856d9f289 service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:48.070192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:48.071299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:48.071803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:48.072189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] PATH_INFO: `/v3/projects/e849184f8ead4d89b59f972c0578cdc2/users/9e8dadf3de8647189b05394572b3dfff/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:48.095138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e849184f8ead4d89b59f972c0578cdc2, user_id=9e8dadf3de8647189b05394572b3dfff, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:48.098638 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:48.125917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 901/1803] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:48 2022] PUT /identity/v3/projects/e849184f8ead4d89b59f972c0578cdc2/users/9e8dadf3de8647189b05394572b3dfff/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:48.136645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:48.137025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:48.137593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:48.209252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] MFA Rules not processed for user `9e8dadf3de8647189b05394572b3dfff`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:48.210678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:48.356716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 903/1804] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:48.364429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:48.466635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:48.468143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:48.512300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c376-f50e-48fd-b3dc-a35a3c2ce570 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:48.526094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:48.526800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:48.527085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:48.527362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:48.528071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:48.531184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:48.590569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 902/1805] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:48 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:48.595460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:48.628252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c25b-50ea-4d77-a21f-a69d14a87d06 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:48.786534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:48.788222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:48.789464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:48.790659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] PATH_INFO: `/v3/projects/c07daeadf886436f8ab335aecf000283` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:48.794565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07daeadf886436f8ab335aecf000283)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:48.797861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:48.802715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c67b2-7c84-4347-ade9-9afd51dbe897 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:48.816825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:48.817608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:48.817958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:48.819175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:48.821652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:48.823834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:48.908907 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 903/1806] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:48 2022] POST /identity/v3/users => generated 299 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:48.913085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:48.946471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af7f2-3916-4396-8e71-47cfcc6385ae admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:48.963705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07daeadf886436f8ab335aecf000283', 'request_id': 'req-601d8d48-04fb-40eb-8ab9-70cb2d840c00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:48.999032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07daeadf886436f8ab335aecf000283', 'request_id': 'req-601d8d48-04fb-40eb-8ab9-70cb2d840c00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:49.012101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07daeadf886436f8ab335aecf000283', 'request_id': 'req-601d8d48-04fb-40eb-8ab9-70cb2d840c00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:49.037071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] The token cache is being invalidate because project c07daeadf886436f8ab335aecf000283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:49.037369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:49.038205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-601d8d48-04fb-40eb-8ab9-70cb2d840c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:49.040308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 904/1807] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:48 2022] DELETE /identity/v3/projects/c07daeadf886436f8ab335aecf000283 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:49.045480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2647b-d951-4c67-b0f5-9f4e2a6e345f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.045803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2647b-d951-4c67-b0f5-9f4e2a6e345f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.046086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2647b-d951-4c67-b0f5-9f4e2a6e345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.064909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8ce2647b-d951-4c67-b0f5-9f4e2a6e345f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:49.065096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.065800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.066091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.066195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8ce2647b-d951-4c67-b0f5-9f4e2a6e345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:49.066361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.067172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.068809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.076714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 905/1808] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:49.078868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 904/1809] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:49.084300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad811-4999-4225-ac50-fd3ab84419d5 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.084600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad811-4999-4225-ac50-fd3ab84419d5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.085603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.086180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad811-4999-4225-ac50-fd3ab84419d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.087513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:49.100011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0743a8f-a0cf-444e-9fa2-c515988715d1 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.104887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.105892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.106073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-af4ad811-4999-4225-ac50-fd3ab84419d5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:49.106296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.106636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] PATH_INFO: `/v3/projects/f6d7dcef0c80419c9c7ffbde1f559c1e/users/ef9aa396d8bd4dcd973057f81ccb8552/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.107282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-af4ad811-4999-4225-ac50-fd3ab84419d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:49.115300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 906/1810] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:49.119516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad811-4999-4225-ac50-fd3ab84419d5 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.122032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d7dcef0c80419c9c7ffbde1f559c1e, user_id=ef9aa396d8bd4dcd973057f81ccb8552, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.124721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.128638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad811-4999-4225-ac50-fd3ab84419d5 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.133603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.134257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.134543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.134816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.135546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:49.135850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.137513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.139594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 905/1811] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:49 2022] PUT /identity/v3/projects/f6d7dcef0c80419c9c7ffbde1f559c1e/users/ef9aa396d8bd4dcd973057f81ccb8552/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:49.145237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.150406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 907/1812] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:58:49.155397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.170393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801c8bd-3023-4c60-9bcc-84724728f1d1 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.221885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ca33-13ea-49be-bc30-ab8e3d11d391 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.227191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.228079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.228504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.228952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.230027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.231782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.244713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.244949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 906/1813] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:49.245527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.245926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.246250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.247024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.249251 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.250253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.263561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e8741-be29-41fe-aa67-df71cbc53906 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.269002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca694b2-0883-4d9f-a790-219d1484d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.269865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca694b2-0883-4d9f-a790-219d1484d240 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.270175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca694b2-0883-4d9f-a790-219d1484d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.270397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca694b2-0883-4d9f-a790-219d1484d240 admin admin] PATH_INFO: `/v3/projects/f6d7dcef0c80419c9c7ffbde1f559c1e/users/ef9aa396d8bd4dcd973057f81ccb8552/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.273056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca694b2-0883-4d9f-a790-219d1484d240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d7dcef0c80419c9c7ffbde1f559c1e, user_id=ef9aa396d8bd4dcd973057f81ccb8552, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.275766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca694b2-0883-4d9f-a790-219d1484d240 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.288718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 908/1814] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:49.290624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 907/1815] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:49 2022] PUT /identity/v3/projects/f6d7dcef0c80419c9c7ffbde1f559c1e/users/ef9aa396d8bd4dcd973057f81ccb8552/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:49.300861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.302475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.302964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.303367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.330717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] MFA Rules not processed for user `ef9aa396d8bd4dcd973057f81ccb8552`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:49.332076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:49.368465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b5edc-6417-4483-ac80-81be66c8022f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.378072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.378292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.378546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.378846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.379533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.387148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.412513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 908/1816] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:58:49.424726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.426296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 909/1817] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:49.426445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:49.427737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.439960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02f26-434e-4a92-8938-730a03b72c87 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.447445 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.449059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.449059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.450059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.451119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.453946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.468837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 910/1818] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:49.472155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.488555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6695db-5654-4a16-b38c-a3fb699e0502 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.493259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.493933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.494209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.494479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.495206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.496814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.499933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937027c-7bb9-4ab6-bb0f-a461e479ba34 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.504361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba7aa-f44b-4e3e-b076-63ae9d924dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.505166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba7aa-f44b-4e3e-b076-63ae9d924dac service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.505543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba7aa-f44b-4e3e-b076-63ae9d924dac service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.505930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba7aa-f44b-4e3e-b076-63ae9d924dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.507967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 911/1819] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:49.512428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.517075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba7aa-f44b-4e3e-b076-63ae9d924dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.518519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba7aa-f44b-4e3e-b076-63ae9d924dac service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.524934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75583-9a4c-495e-b8e2-79756703e420 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.529080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 909/1820] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:58:49.529670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.530634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.530934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.531192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] PATH_INFO: `/v3/projects/6ba5c3d2e21d444fa5ef36dd72fa4790/users/f00b4d82d073445fa9f07deef2da8d5a/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.547561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba5c3d2e21d444fa5ef36dd72fa4790, user_id=f00b4d82d073445fa9f07deef2da8d5a, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.551398 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.568809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 912/1821] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:49 2022] PUT /identity/v3/projects/6ba5c3d2e21d444fa5ef36dd72fa4790/users/f00b4d82d073445fa9f07deef2da8d5a/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:49.579081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c705-ad0c-40ba-a07d-d7e8d714a612 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.579330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c705-ad0c-40ba-a07d-d7e8d714a612 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.579604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c705-ad0c-40ba-a07d-d7e8d714a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.606696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8905c705-ad0c-40ba-a07d-d7e8d714a612 None None] MFA Rules not processed for user `f00b4d82d073445fa9f07deef2da8d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:49.607952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8905c705-ad0c-40ba-a07d-d7e8d714a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:49.680212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 910/1822] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:49.685423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.773512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2a52-319e-4eff-8570-e0a8fdf9c2c5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.778199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.778871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.779158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.780814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.780814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.782135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.814877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 913/1823] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:49.819437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c705-ad0c-40ba-a07d-d7e8d714a612 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.833631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c705-ad0c-40ba-a07d-d7e8d714a612 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.911747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.912548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.912921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.913204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.913927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.940595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:49.974442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 911/1824] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:49 2022] POST /identity/v3/users => generated 306 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:49.976192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:49.988643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444847e9-3c68-495d-8713-ba521f414f9d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:49.994694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:49.995845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:49.996365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:49.996859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:49.997876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:49.999774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:50.016281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 914/1825] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:50.017279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:50.029505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383b0e6-3e22-4802-8ca2-98ff9acd95a2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:50.036732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:50.037652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:50.037937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:50.038213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] PATH_INFO: `/v3/projects/b741e1ab775e4919a2bede5cc182b74c/users/19776d18543c4fc0b8a047ee0d31e9a1/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:50.056158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b741e1ab775e4919a2bede5cc182b74c, user_id=19776d18543c4fc0b8a047ee0d31e9a1, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:50.059476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:50.085081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 912/1826] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:50 2022] PUT /identity/v3/projects/b741e1ab775e4919a2bede5cc182b74c/users/19776d18543c4fc0b8a047ee0d31e9a1/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:50.089217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:50.104172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642a23a-62cd-4922-a0d4-c777f4f71e10 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:50.119269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:50.122072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:50.191914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:50.192911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:50.193914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:50.194045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a7df-0039-474e-9179-624f2408c30a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:50.194203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:50.195077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:50.196883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:50.198463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:50.199132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:50.199417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:50.199837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:50.202076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:50.212626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 915/1827] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:50.215746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:50.229527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea831-4b6c-4568-ad4f-7a4d3ac35ad3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:50.238689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786c3b-8ee6-4375-a7dc-74e6cff9654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:50.240155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786c3b-8ee6-4375-a7dc-74e6cff9654c admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:50.241006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786c3b-8ee6-4375-a7dc-74e6cff9654c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:50.241307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786c3b-8ee6-4375-a7dc-74e6cff9654c admin admin] PATH_INFO: `/v3/projects/b741e1ab775e4919a2bede5cc182b74c/users/19776d18543c4fc0b8a047ee0d31e9a1/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:50.247425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786c3b-8ee6-4375-a7dc-74e6cff9654c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b741e1ab775e4919a2bede5cc182b74c, user_id=19776d18543c4fc0b8a047ee0d31e9a1, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:50.250129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786c3b-8ee6-4375-a7dc-74e6cff9654c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:50.262502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 916/1828] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:50 2022] PUT /identity/v3/projects/b741e1ab775e4919a2bede5cc182b74c/users/19776d18543c4fc0b8a047ee0d31e9a1/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:50.274005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f096e-4ed7-46d9-867d-4fab5a555262 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:50.274681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f096e-4ed7-46d9-867d-4fab5a555262 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:50.274788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:50.275233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f096e-4ed7-46d9-867d-4fab5a555262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:50.276199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:50.295948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 913/1829] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:58:50.305851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-e56f096e-4ed7-46d9-867d-4fab5a555262 None None] MFA Rules not processed for user `19776d18543c4fc0b8a047ee0d31e9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:50.307131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e56f096e-4ed7-46d9-867d-4fab5a555262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:50.393013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 917/1830] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:50.404218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:50.425552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223a99-f7d9-4305-a094-675f0880b88c service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:50.499064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:50.500078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:50.500487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:50.501133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:50.515472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:50.518815 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:50.527684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 914/1831] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:50.698646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f096e-4ed7-46d9-867d-4fab5a555262 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:50.711840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f096e-4ed7-46d9-867d-4fab5a555262 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:50.720382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:50.721135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:50.721417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:50.721691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:50.824864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:50.826616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:50.836139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 918/1832] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:54.728631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:54.741996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdef32-4ff8-4bf2-a212-d75b266aa09f service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:54.746858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ea94-89a9-4828-a610-9c71836df875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:54.747695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ea94-89a9-4828-a610-9c71836df875 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:54.748128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ea94-89a9-4828-a610-9c71836df875 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:54.748593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ea94-89a9-4828-a610-9c71836df875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:54.752178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-db29ea94-89a9-4828-a610-9c71836df875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:54.829858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ea94-89a9-4828-a610-9c71836df875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:54.831630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ea94-89a9-4828-a610-9c71836df875 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:54.853944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 915/1833] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:55.107236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:55.172097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c2069-82ca-456e-9fa6-73a8dfaaf273 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:55.177358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:55.178534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:55.179014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:55.179326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] PATH_INFO: `/v3/users/f00b4d82d073445fa9f07deef2da8d5a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:55.180548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00b4d82d073445fa9f07deef2da8d5a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:55.182857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:55.266306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00b4d82d073445fa9f07deef2da8d5a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.267239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00b4d82d073445fa9f07deef2da8d5a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.283006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00b4d82d073445fa9f07deef2da8d5a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.298943 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00b4d82d073445fa9f07deef2da8d5a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.311674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00b4d82d073445fa9f07deef2da8d5a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.318428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 919/1834] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:55 2022] DELETE /identity/v3/users/f00b4d82d073445fa9f07deef2da8d5a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:55.323681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:55.323988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:55.324345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:55.345352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:55.346777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:55.420940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 916/1835] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:55.436128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:55.437636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:55.509111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85c11-e865-4686-a917-f1a711764fe6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:55.518270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:55.519454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:55.519454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:55.519625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:55.543323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:55.544807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:55.555669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 920/1836] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:55.666426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:55.668128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:55.692302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0b5d9-9e63-45e8-8348-57f0fcdb72cc None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:55.701487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:55.707972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:55.708615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:55.713063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] PATH_INFO: `/v3/users/780860a3eb59486cab5c7943915287cb` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:55.715589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=780860a3eb59486cab5c7943915287cb)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:55.718045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:55.803379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780860a3eb59486cab5c7943915287cb'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.804331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780860a3eb59486cab5c7943915287cb'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.813536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780860a3eb59486cab5c7943915287cb'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.828857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780860a3eb59486cab5c7943915287cb'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.836030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780860a3eb59486cab5c7943915287cb'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:55.844566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 917/1837] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:55 2022] DELETE /identity/v3/users/780860a3eb59486cab5c7943915287cb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:56.054304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:56.055795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:56.091339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b5b2-9337-4ecd-a16d-951579632f08 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:56.183698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:56.185242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:56.231726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:56.233250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:56.233784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:56.234250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] PATH_INFO: `/v3/projects/6ba5c3d2e21d444fa5ef36dd72fa4790` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:56.236046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba5c3d2e21d444fa5ef36dd72fa4790)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:56.238926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:56.298516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d453-5ee6-4f0d-9cd7-ba985ed8e321 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:56.342577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba5c3d2e21d444fa5ef36dd72fa4790', 'request_id': 'req-87eef5b2-525b-49a8-8124-39c0fa94672f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.360494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba5c3d2e21d444fa5ef36dd72fa4790', 'request_id': 'req-87eef5b2-525b-49a8-8124-39c0fa94672f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.370474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba5c3d2e21d444fa5ef36dd72fa4790', 'request_id': 'req-87eef5b2-525b-49a8-8124-39c0fa94672f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.388051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:56.388051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:56.388051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:56.388051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] PATH_INFO: `/v3/projects/8e55c8cdfa504adfb502346a2a9c909c` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:56.388511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e55c8cdfa504adfb502346a2a9c909c)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:56.388511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:56.400568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] The token cache is being invalidate because project 6ba5c3d2e21d444fa5ef36dd72fa4790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:56.400568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.403272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.408997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 921/1838] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:56 2022] DELETE /identity/v3/projects/6ba5c3d2e21d444fa5ef36dd72fa4790 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:56.413352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:56.418188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:56.438653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eef5b2-525b-49a8-8124-39c0fa94672f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:56.446342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:56.447589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:56.453459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:56.454700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] PATH_INFO: `/v3/users/19776d18543c4fc0b8a047ee0d31e9a1` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:56.457011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19776d18543c4fc0b8a047ee0d31e9a1)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:56.459168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:56.493035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e55c8cdfa504adfb502346a2a9c909c', 'request_id': 'req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.510526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e55c8cdfa504adfb502346a2a9c909c', 'request_id': 'req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.520889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e55c8cdfa504adfb502346a2a9c909c', 'request_id': 'req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.543314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] The token cache is being invalidate because project 8e55c8cdfa504adfb502346a2a9c909c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:56.545819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.547246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.549869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 918/1839] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:56 2022] DELETE /identity/v3/projects/8e55c8cdfa504adfb502346a2a9c909c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:56.554313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:56.556140 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:56.563645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19776d18543c4fc0b8a047ee0d31e9a1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.564517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19776d18543c4fc0b8a047ee0d31e9a1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.579900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19776d18543c4fc0b8a047ee0d31e9a1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.613704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19776d18543c4fc0b8a047ee0d31e9a1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.622058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19776d18543c4fc0b8a047ee0d31e9a1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.630321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 922/1840] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:56 2022] DELETE /identity/v3/users/19776d18543c4fc0b8a047ee0d31e9a1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:56.650348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcfc9d-ee14-4ff0-b4a9-c49c4bed8a40 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:56.725053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:56.726891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:56.727532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:56.727876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] PATH_INFO: `/v3/users/76b85778d788446b834b04e607c80e12` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:56.729657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b85778d788446b834b04e607c80e12)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:56.734014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:56.802861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b85778d788446b834b04e607c80e12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.804338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b85778d788446b834b04e607c80e12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.817801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b85778d788446b834b04e607c80e12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.834240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b85778d788446b834b04e607c80e12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.845061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b85778d788446b834b04e607c80e12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:56.863964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 919/1841] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:56 2022] DELETE /identity/v3/users/76b85778d788446b834b04e607c80e12 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:57.010768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.012325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.026136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e90348-5925-4613-8ba5-e05b8b570287 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.125606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.127594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.128263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.128913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] PATH_INFO: `/v3/projects/b741e1ab775e4919a2bede5cc182b74c` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.130383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b741e1ab775e4919a2bede5cc182b74c)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.146397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.171258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.172768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.197390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3754b38-1097-4b10-8c8d-050b88d7f43d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.202747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.203543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.203826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.204134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] PATH_INFO: `/v3/projects/c0fadc7d6f14426c9859b261b1444fd4` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.205436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fadc7d6f14426c9859b261b1444fd4)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.207874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.225794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b741e1ab775e4919a2bede5cc182b74c', 'request_id': 'req-61b25bbb-4497-43fd-b8aa-566e71968ba1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.233738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b741e1ab775e4919a2bede5cc182b74c', 'request_id': 'req-61b25bbb-4497-43fd-b8aa-566e71968ba1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.241462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b741e1ab775e4919a2bede5cc182b74c', 'request_id': 'req-61b25bbb-4497-43fd-b8aa-566e71968ba1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.253385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] The token cache is being invalidate because project b741e1ab775e4919a2bede5cc182b74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:57.253667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.254319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-61b25bbb-4497-43fd-b8aa-566e71968ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.255920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 923/1842] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:57 2022] DELETE /identity/v3/projects/b741e1ab775e4919a2bede5cc182b74c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:57.259287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fadc7d6f14426c9859b261b1444fd4', 'request_id': 'req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.260920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9b2c-895e-4c49-a461-c4633183046e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.261245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9b2c-895e-4c49-a461-c4633183046e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.261540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9b2c-895e-4c49-a461-c4633183046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.265480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fadc7d6f14426c9859b261b1444fd4', 'request_id': 'req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.273635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fadc7d6f14426c9859b261b1444fd4', 'request_id': 'req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.280639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-108d9b2c-895e-4c49-a461-c4633183046e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:57.282077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-108d9b2c-895e-4c49-a461-c4633183046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.284246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] The token cache is being invalidate because project c0fadc7d6f14426c9859b261b1444fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:57.284626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.285247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-23710f6d-30b2-45a4-9cd4-5029a02dd6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.286802 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 920/1843] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:57 2022] DELETE /identity/v3/projects/c0fadc7d6f14426c9859b261b1444fd4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:58:57.291690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14df18-1c9f-4eb8-ac1f-b356c43a7cd2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.292006 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14df18-1c9f-4eb8-ac1f-b356c43a7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.292282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14df18-1c9f-4eb8-ac1f-b356c43a7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.315287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3d14df18-1c9f-4eb8-ac1f-b356c43a7cd2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:57.316557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3d14df18-1c9f-4eb8-ac1f-b356c43a7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.345350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 924/1844] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:57.353837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d2ae6-f7c4-467d-bf76-f070af7ef2e8 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.354245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d2ae6-f7c4-467d-bf76-f070af7ef2e8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.354723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d2ae6-f7c4-467d-bf76-f070af7ef2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.381979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-488d2ae6-f7c4-467d-bf76-f070af7ef2e8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:57.383201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-488d2ae6-f7c4-467d-bf76-f070af7ef2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.395005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 921/1845] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:57.403178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b052f1-742a-4c61-9fad-078f2d16ec87 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.403719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b052f1-742a-4c61-9fad-078f2d16ec87 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.404154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b052f1-742a-4c61-9fad-078f2d16ec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.411264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 925/1846] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:57.414485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d2ae6-f7c4-467d-bf76-f070af7ef2e8 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.446728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d2ae6-f7c4-467d-bf76-f070af7ef2e8 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.453106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-72b052f1-742a-4c61-9fad-078f2d16ec87 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:57.456810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-72b052f1-742a-4c61-9fad-078f2d16ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.461263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.461263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.461263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.461624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.462434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:57.462749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.464550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.478094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 922/1847] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:57.485940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 926/1848] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:57.486146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b052f1-742a-4c61-9fad-078f2d16ec87 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.487284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.500264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d428fb-ac51-4fb1-914b-336c17c5ca93 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.503818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b052f1-742a-4c61-9fad-078f2d16ec87 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.506585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.507314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.507600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.508001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.510193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.511239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.515368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.516182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.516561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.517321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.517961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:58:57.518365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.522195 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.547532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 923/1849] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:58:57.552005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.562925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 927/1850] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:57.564223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.569253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fba0e-ab63-4b2e-9dd5-a8b3cdcc31bb admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.648579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.649381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.649729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.650100 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.650859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.653200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.683583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321852-5fcc-47fa-ad55-a6bf79d9af40 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.693509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 924/1851] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:57.693509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.695511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.697873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.697873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.697873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.697873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.698381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.700427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.728948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 928/1852] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:57.730946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.741884 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd57d9-69c9-445c-90c7-68e2f9725dbc admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.777505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086714aa-ae51-4bee-a24f-048bd77b1b70 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.787654 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.788564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.788879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.789153 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] PATH_INFO: `/v3/users/9a122a207434429b9a075894ae062a06` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.790483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a122a207434429b9a075894ae062a06)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.792427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.823343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.824033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.824313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.824583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.825328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.827217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.838484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a122a207434429b9a075894ae062a06'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.839180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a122a207434429b9a075894ae062a06'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.846807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a122a207434429b9a075894ae062a06'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.851751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 929/1853] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:57.851751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.851751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.859973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a122a207434429b9a075894ae062a06'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.862660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec895629-4aba-4f9f-b172-744142cfa2bc admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.868443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a4cb1-5757-4c31-9fc8-952457e67c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.869238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4cb1-5757-4c31-9fc8-952457e67c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.869673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4cb1-5757-4c31-9fc8-952457e67c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.870163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4cb1-5757-4c31-9fc8-952457e67c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.871037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a4cb1-5757-4c31-9fc8-952457e67c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.872827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a4cb1-5757-4c31-9fc8-952457e67c7c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.876048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a122a207434429b9a075894ae062a06'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:57.886560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 925/1854] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:57 2022] DELETE /identity/v3/users/9a122a207434429b9a075894ae062a06 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:57.887172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:57.889813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.892985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 930/1855] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:57.892985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241a54-3c4b-4f03-ad1e-14bc7b500fde None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.892985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241a54-3c4b-4f03-ad1e-14bc7b500fde None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.892985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241a54-3c4b-4f03-ad1e-14bc7b500fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.918627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-bf241a54-3c4b-4f03-ad1e-14bc7b500fde None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:57.919803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-bf241a54-3c4b-4f03-ad1e-14bc7b500fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:57.983611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe548-029a-4f30-895e-aa06f3828916 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:57.988861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:57.989784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:57.989952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:57.990384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:57.991034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:57.992646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:57.999203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 931/1856] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:58.000667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241a54-3c4b-4f03-ad1e-14bc7b500fde None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.004867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 926/1857] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:58.008779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.014586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241a54-3c4b-4f03-ad1e-14bc7b500fde None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.019724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.020082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b658e1-5098-42fd-bac9-6136a4e46b65 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.020403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.020774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.021007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.021749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.023420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.027367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.030152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.031215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.031890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.033060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.034950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 932/1858] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:58.035126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.036019 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.037852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:58.047772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 927/1859] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:58:58.049648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.067942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ce5cc-2139-40b2-9f01-43c54f0b6469 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.074709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.075974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.076433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.076867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] PATH_INFO: `/v3/projects/d3bb754fe26249ebabf01c8d9f27b2b3/users/40df5e89aa8e45b699d0b2e6b078dc96/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.098177 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bb754fe26249ebabf01c8d9f27b2b3, user_id=40df5e89aa8e45b699d0b2e6b078dc96, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.101051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.125356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 928/1860] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:58 2022] PUT /identity/v3/projects/d3bb754fe26249ebabf01c8d9f27b2b3/users/40df5e89aa8e45b699d0b2e6b078dc96/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:58.129398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.140275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10936cff-456e-4906-9d33-dfb6e952bd25 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.201237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f9f23-2863-4ddc-884c-a9ab8d4570c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.202139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f9f23-2863-4ddc-884c-a9ab8d4570c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.202529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f9f23-2863-4ddc-884c-a9ab8d4570c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.202906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f9f23-2863-4ddc-884c-a9ab8d4570c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.234894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0faf0d-1158-46ef-91ab-c6794b3f5ee7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.241018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de53e76-e29f-4e0a-ab37-1d5418e4aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.242010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53e76-e29f-4e0a-ab37-1d5418e4aded admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.242396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53e76-e29f-4e0a-ab37-1d5418e4aded admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.242778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53e76-e29f-4e0a-ab37-1d5418e4aded admin admin] PATH_INFO: `/v3/projects/46ad3099cd7b4b6f8f6c8f9f4cfa87d9/users/b5d749aa41c642b1a652bbdca3dda7e8/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.266023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de53e76-e29f-4e0a-ab37-1d5418e4aded admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ad3099cd7b4b6f8f6c8f9f4cfa87d9, user_id=b5d749aa41c642b1a652bbdca3dda7e8, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.268997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de53e76-e29f-4e0a-ab37-1d5418e4aded admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.286152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 929/1861] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:58 2022] PUT /identity/v3/projects/46ad3099cd7b4b6f8f6c8f9f4cfa87d9/users/b5d749aa41c642b1a652bbdca3dda7e8/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:58.287949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcce15-9013-452f-9e72-39bf4e72d983 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.288365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcce15-9013-452f-9e72-39bf4e72d983 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.288648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcce15-9013-452f-9e72-39bf4e72d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.292545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f9f23-2863-4ddc-884c-a9ab8d4570c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.294046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f9f23-2863-4ddc-884c-a9ab8d4570c7 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.305187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 933/1862] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:58.306493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8206-4303-4b11-9647-9191e1316ce1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.306812 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8206-4303-4b11-9647-9191e1316ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.307124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8206-4303-4b11-9647-9191e1316ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.319386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4bfcce15-9013-452f-9e72-39bf4e72d983 None None] MFA Rules not processed for user `40df5e89aa8e45b699d0b2e6b078dc96`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:58.320773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4bfcce15-9013-452f-9e72-39bf4e72d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:58.335434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-cf7f8206-4303-4b11-9647-9191e1316ce1 None None] MFA Rules not processed for user `b5d749aa41c642b1a652bbdca3dda7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:58.337227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-cf7f8206-4303-4b11-9647-9191e1316ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:58.420955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 930/1863] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:58.425705 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcce15-9013-452f-9e72-39bf4e72d983 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.435592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 934/1864] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:58.440573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f8206-4303-4b11-9647-9191e1316ce1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.545690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f8206-4303-4b11-9647-9191e1316ce1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.555458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.556168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcce15-9013-452f-9e72-39bf4e72d983 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.556533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.557383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.557845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.559388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.561341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.561765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.562150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.562504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.562851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.563695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.565759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.607658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 935/1865] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:58 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:58.609438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 931/1866] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:58:58 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:58.612378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.613577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.697605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3928-9ede-43a0-aeb6-473bcccf8a0a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.703804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.704482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.704800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.705491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.705624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80154f5a-b8b4-47cf-9382-ba2c88b0b4e6 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.705891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.708101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.710822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.711697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.712082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.712449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.713272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.715271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.739199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 936/1867] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:58 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:58:58.739199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.739469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 932/1868] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:58:58 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:58:58.739556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:58.739652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.749346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d745321-b4e8-413d-ab12-e4eda6653aa8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.752231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdba1b3-d0b1-4511-814f-16ec5a4f4120 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.755328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.755916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.756199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.756476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.757368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.758369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.759068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.759443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.759824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.760204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] PATH_INFO: `/v3/projects/01960e19a1e64f0798b5618652d9ef7a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.761553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01960e19a1e64f0798b5618652d9ef7a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.763903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.772393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 933/1869] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:58.772393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.783361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d908da-f9fb-4c49-8bdd-dd75309a1fb8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.789146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.789935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.790896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.791236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.792280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.794009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.808733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 934/1870] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:58.808733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.819047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521c23-fb41-4afe-abf6-9037ed8ff1c0 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.832830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01960e19a1e64f0798b5618652d9ef7a', 'request_id': 'req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:58.857214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01960e19a1e64f0798b5618652d9ef7a', 'request_id': 'req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:58.880431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01960e19a1e64f0798b5618652d9ef7a', 'request_id': 'req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:58.899295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] The token cache is being invalidate because project 01960e19a1e64f0798b5618652d9ef7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:58:58.899588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:58.900991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:58.902541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.904860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.905149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.905466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] PATH_INFO: `/v3/projects/7d9440d290ac4c5eaa5369ebf7dc21b1/users/3c583f470062449c894c3017a39f3d38/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.905682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 937/1871] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:58:58 2022] DELETE /identity/v3/projects/01960e19a1e64f0798b5618652d9ef7a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:58.907549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.910678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:58.930976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9440d290ac4c5eaa5369ebf7dc21b1, user_id=3c583f470062449c894c3017a39f3d38, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.933901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:58.939407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33fc7-ac99-47f9-af41-a1cb8b9c5f3a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:58.947419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:58.948383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:58.948667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:58.950099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] PATH_INFO: `/v3/projects/a987af8847854e2d873272fc078c20ab/users/3331cd07b95844c79643ddd3380704b6/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:58.956794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 935/1872] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:58 2022] PUT /identity/v3/projects/7d9440d290ac4c5eaa5369ebf7dc21b1/users/3c583f470062449c894c3017a39f3d38/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:58.957433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:58.962998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:58.972342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a987af8847854e2d873272fc078c20ab, user_id=3331cd07b95844c79643ddd3380704b6, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:58.975162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.014160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 938/1873] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:58 2022] PUT /identity/v3/projects/a987af8847854e2d873272fc078c20ab/users/3331cd07b95844c79643ddd3380704b6/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:59.015737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:59.018767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.051390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd371a5-8d99-45be-b4bc-bd118561970b admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.092002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69887bf0-8a05-46e8-8f0f-e35837f539ed admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.096951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.098022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.098299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.098499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.099232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.100859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.109285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.110266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.110819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.111188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] PATH_INFO: `/v3/users/9e8dadf3de8647189b05394572b3dfff` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.111976 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 939/1874] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:59.116610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:59.116860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8dadf3de8647189b05394572b3dfff)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.116860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.124905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdcff5-1f4b-48c4-8bbd-05bbf4756742 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.130897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.131630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.131921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.132197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.133112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.134873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.146549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 940/1875] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:58:59.147373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:59.157905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2286c8-59e9-4af4-9254-aa899dfa009a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.162734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.163655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.163942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.164217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] PATH_INFO: `/v3/projects/7d9440d290ac4c5eaa5369ebf7dc21b1/users/3c583f470062449c894c3017a39f3d38/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.166519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9440d290ac4c5eaa5369ebf7dc21b1, user_id=3c583f470062449c894c3017a39f3d38, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.169647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.172163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8dadf3de8647189b05394572b3dfff'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:59.173236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8dadf3de8647189b05394572b3dfff'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:59.181627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 941/1876] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:59 2022] PUT /identity/v3/projects/7d9440d290ac4c5eaa5369ebf7dc21b1/users/3c583f470062449c894c3017a39f3d38/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:59.190712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:59.190712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.196205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8dadf3de8647189b05394572b3dfff'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:59.214626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8dadf3de8647189b05394572b3dfff'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:59.226956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d05cb476-c91d-44cd-b1c4-dfb9ae3fa9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8dadf3de8647189b05394572b3dfff'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:58:59.235379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 936/1877] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:58:58 2022] DELETE /identity/v3/users/9e8dadf3de8647189b05394572b3dfff => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:59.236982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.237326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.237713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.258585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6ea76-924a-4ec4-aa6b-080f2503f92a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.271010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] MFA Rules not processed for user `3c583f470062449c894c3017a39f3d38`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:59.272867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.342085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e4b42-6cae-4a85-a844-26ef6254ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.343336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4b42-6cae-4a85-a844-26ef6254ecad admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.343534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4b42-6cae-4a85-a844-26ef6254ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.343810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4b42-6cae-4a85-a844-26ef6254ecad admin admin] PATH_INFO: `/v3/projects/a987af8847854e2d873272fc078c20ab/users/3331cd07b95844c79643ddd3380704b6/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.347269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4b42-6cae-4a85-a844-26ef6254ecad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a987af8847854e2d873272fc078c20ab, user_id=3331cd07b95844c79643ddd3380704b6, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.350833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4b42-6cae-4a85-a844-26ef6254ecad admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.365915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 942/1878] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:58:59 2022] PUT /identity/v3/projects/a987af8847854e2d873272fc078c20ab/users/3331cd07b95844c79643ddd3380704b6/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:58:59.378192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.378618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.378904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.393901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 937/1879] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:59.406143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:59.407841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.433866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] MFA Rules not processed for user `3331cd07b95844c79643ddd3380704b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:58:59.435099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.511150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e03b11-630a-4bf6-992f-39aded1fc5f9 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.532850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 943/1880] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:58:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:58:59.573995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:59.575471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.576048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.577176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.577627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.578235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.580534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.587474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677f33-d30d-4bcd-b407-657b02610f7c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.591299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.592143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.592626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.592937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.603052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.604512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.615638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 944/1881] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:59.646694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.648431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.658414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 938/1882] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:58:59.732503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:58:59.747149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142a89-cbdd-42df-9faf-cd3123d9a0e9 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:58:59.752133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:58:59.753040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:58:59.753547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:58:59.753830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:58:59.756038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:58:59.826451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:58:59.827844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:58:59.838444 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 945/1883] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:58:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:00.091072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:00.093075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:00.254776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d4a47-1260-439f-99c6-75259ae90c2c service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:00.270251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:00.271228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:00.272144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:00.272144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] PATH_INFO: `/v3/projects/e849184f8ead4d89b59f972c0578cdc2` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:00.274011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e849184f8ead4d89b59f972c0578cdc2)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:00.276001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:00.346368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e849184f8ead4d89b59f972c0578cdc2', 'request_id': 'req-39883744-39d0-4d6a-afb7-1e3ddae63dd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.379101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e849184f8ead4d89b59f972c0578cdc2', 'request_id': 'req-39883744-39d0-4d6a-afb7-1e3ddae63dd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.386702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e849184f8ead4d89b59f972c0578cdc2', 'request_id': 'req-39883744-39d0-4d6a-afb7-1e3ddae63dd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.408987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] The token cache is being invalidate because project e849184f8ead4d89b59f972c0578cdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:00.411911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.412920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.415259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 939/1884] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:00 2022] DELETE /identity/v3/projects/e849184f8ead4d89b59f972c0578cdc2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:00.419879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:00.439343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba6927-5ee8-41c3-9f6b-c7dce2bab04a service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:00.549379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:00.551289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:00.551573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:00.551846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] PATH_INFO: `/v3/users/ef9aa396d8bd4dcd973057f81ccb8552` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:00.555044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9aa396d8bd4dcd973057f81ccb8552)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:00.558581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:00.654190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9aa396d8bd4dcd973057f81ccb8552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.654900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9aa396d8bd4dcd973057f81ccb8552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.667359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9aa396d8bd4dcd973057f81ccb8552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.682313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9aa396d8bd4dcd973057f81ccb8552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.690166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eaede9f1-1114-4ca4-9420-b7c609fd3de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9aa396d8bd4dcd973057f81ccb8552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:00.696551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 946/1885] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:00 2022] DELETE /identity/v3/users/ef9aa396d8bd4dcd973057f81ccb8552 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:01.003324 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:01.004885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:01.033772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39883744-39d0-4d6a-afb7-1e3ddae63dd4 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:01.101469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:01.102412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.102640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.102916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] PATH_INFO: `/v3/projects/f6d7dcef0c80419c9c7ffbde1f559c1e` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.104134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d7dcef0c80419c9c7ffbde1f559c1e)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:01.106106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:01.160113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d7dcef0c80419c9c7ffbde1f559c1e', 'request_id': 'req-ee66ff78-b104-41d4-b57c-50ac808c9ade'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:01.168464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d7dcef0c80419c9c7ffbde1f559c1e', 'request_id': 'req-ee66ff78-b104-41d4-b57c-50ac808c9ade'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:01.176699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d7dcef0c80419c9c7ffbde1f559c1e', 'request_id': 'req-ee66ff78-b104-41d4-b57c-50ac808c9ade'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:01.188231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] The token cache is being invalidate because project f6d7dcef0c80419c9c7ffbde1f559c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:01.188714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:01.189844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ee66ff78-b104-41d4-b57c-50ac808c9ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:01.192461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 940/1886] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:01 2022] DELETE /identity/v3/projects/f6d7dcef0c80419c9c7ffbde1f559c1e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:01.198116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5def18-2c53-4a7f-a6b6-abb6642aed66 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.198412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5def18-2c53-4a7f-a6b6-abb6642aed66 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.198692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5def18-2c53-4a7f-a6b6-abb6642aed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.219607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7a5def18-2c53-4a7f-a6b6-abb6642aed66 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:01.220968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7a5def18-2c53-4a7f-a6b6-abb6642aed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:01.293210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 947/1887] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:01.300751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af4389-921c-456d-91fa-04e6f44b2c56 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.301044 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af4389-921c-456d-91fa-04e6f44b2c56 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.301325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af4389-921c-456d-91fa-04e6f44b2c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.340982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-62af4389-921c-456d-91fa-04e6f44b2c56 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:01.345303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-62af4389-921c-456d-91fa-04e6f44b2c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:01.370406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 941/1888] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:01.371943 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5def18-2c53-4a7f-a6b6-abb6642aed66 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:01.396259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5def18-2c53-4a7f-a6b6-abb6642aed66 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:01.409724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:01.410432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.410715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.410981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.411737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:01.412038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:01.413713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:01.454996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af4389-921c-456d-91fa-04e6f44b2c56 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:01.465921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 948/1889] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:01.468330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af4389-921c-456d-91fa-04e6f44b2c56 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:01.475847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:01.476818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.477323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.477888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.478698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:01.480731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:01.544352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 942/1890] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:01 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:01.545971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:01.561321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6749d49-3900-40df-a059-498d095ba83a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:01.656789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:01.657771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.657964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.658261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.659247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:01.662383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:01.702714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 949/1891] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:01 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:01.702968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:01.729009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bea691-d1d8-4739-8471-0921aae5cf27 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:01.737249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:01.738611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.739233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.739699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.740633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:01.743311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:01.759003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 943/1892] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:01.763393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:01.784332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d974122-37af-4aee-ae22-cd3caf1dc912 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:01.791075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342adbd7-ee4c-47fd-905b-58873069c16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:01.791075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342adbd7-ee4c-47fd-905b-58873069c16b admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.791075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342adbd7-ee4c-47fd-905b-58873069c16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.791075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342adbd7-ee4c-47fd-905b-58873069c16b admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.791808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342adbd7-ee4c-47fd-905b-58873069c16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:01.793545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342adbd7-ee4c-47fd-905b-58873069c16b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:01.811842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 950/1893] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:01.815926 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:01.834200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24bb07-f528-42bb-a72a-76be90a95ff1 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:01.839432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:01.840373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.840658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.840967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] PATH_INFO: `/v3/projects/e8023df5f0804d37a69712e4c9f77ca8/users/180faa503e054212bd227de8296d71c8/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.875093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8023df5f0804d37a69712e4c9f77ca8, user_id=180faa503e054212bd227de8296d71c8, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:01.878223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:01.905590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 944/1894] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:01 2022] PUT /identity/v3/projects/e8023df5f0804d37a69712e4c9f77ca8/users/180faa503e054212bd227de8296d71c8/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:01.917731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412484-59fc-4a5c-bd81-70e9426eadf2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:01.918021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412484-59fc-4a5c-bd81-70e9426eadf2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:01.918300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412484-59fc-4a5c-bd81-70e9426eadf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:01.980658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f3412484-59fc-4a5c-bd81-70e9426eadf2 None None] MFA Rules not processed for user `180faa503e054212bd227de8296d71c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:01.982204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f3412484-59fc-4a5c-bd81-70e9426eadf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:02.150515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.151132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 951/1895] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:02.235239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5e28-d00f-4998-8c29-cd56152f71df admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.241145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.242108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.242581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.243009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.244500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.247842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.298515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 945/1896] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:02 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:02.299834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412484-59fc-4a5c-bd81-70e9426eadf2 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.315803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412484-59fc-4a5c-bd81-70e9426eadf2 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.390521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.391471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.391891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.392462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.393844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.396989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.422222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 952/1897] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:02 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:02.425904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.440722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552f351-9f38-4d29-9fd7-d5af9e998d06 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.446596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.447764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.448206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.448500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.449285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.452657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.467953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 946/1898] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:02.469287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.480433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c261-8c0b-4f6f-b0d6-cdf458f0e795 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.485136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.486080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.486364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.486642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] PATH_INFO: `/v3/projects/9b1feddf08514631b18d25bfe45ad98b/users/ea535574e01d42fb8cc224b7b64c5cc8/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.503180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1feddf08514631b18d25bfe45ad98b, user_id=ea535574e01d42fb8cc224b7b64c5cc8, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.506079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.524776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 953/1899] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:02 2022] PUT /identity/v3/projects/9b1feddf08514631b18d25bfe45ad98b/users/ea535574e01d42fb8cc224b7b64c5cc8/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:02.529105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.541655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017d9a0-3160-4f31-b019-38aecf228f7d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.603578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a95a1c-e907-40b0-873e-e5c20fdb2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.604259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95a1c-e907-40b0-873e-e5c20fdb2cab admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.604543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95a1c-e907-40b0-873e-e5c20fdb2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.604851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95a1c-e907-40b0-873e-e5c20fdb2cab admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.605678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a95a1c-e907-40b0-873e-e5c20fdb2cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.607500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a95a1c-e907-40b0-873e-e5c20fdb2cab admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.622640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 947/1900] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:02.623784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.634684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7a07-89c4-4e71-a20a-bc73dba22f51 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.641199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.642169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.642455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.643048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] PATH_INFO: `/v3/projects/9b1feddf08514631b18d25bfe45ad98b/users/ea535574e01d42fb8cc224b7b64c5cc8/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.644822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1feddf08514631b18d25bfe45ad98b, user_id=ea535574e01d42fb8cc224b7b64c5cc8, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.647439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.665114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 954/1901] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:02 2022] PUT /identity/v3/projects/9b1feddf08514631b18d25bfe45ad98b/users/ea535574e01d42fb8cc224b7b64c5cc8/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:02.676593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.676906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.677211 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.683260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.685227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:02.714178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] MFA Rules not processed for user `ea535574e01d42fb8cc224b7b64c5cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:02.716052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:02.816946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 948/1902] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:02.828720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a527-4659-42af-ae79-ae457726d7d2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.828720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.830205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.830824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.831423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] PATH_INFO: `/v3/users/40df5e89aa8e45b699d0b2e6b078dc96` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.832821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] RBAC: Authorizing `identity:delete_user(user_id=40df5e89aa8e45b699d0b2e6b078dc96)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.835724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.841287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:02.844057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:02.902805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40df5e89aa8e45b699d0b2e6b078dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:02.903554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40df5e89aa8e45b699d0b2e6b078dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:02.926376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40df5e89aa8e45b699d0b2e6b078dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:02.930404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b562ce-90b1-43af-9a56-32a335841157 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:02.937157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:02.937837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.938121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.938425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.940344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:02.941254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40df5e89aa8e45b699d0b2e6b078dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:02.952786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5d206e7a-b1a1-4c17-bd3f-4f26d9daebec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40df5e89aa8e45b699d0b2e6b078dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:02.954251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:02.955899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:02.961801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 955/1903] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:02 2022] DELETE /identity/v3/users/40df5e89aa8e45b699d0b2e6b078dc96 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:02.966211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:02.966742 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 949/1904] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:02.967038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:02.967322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:02.988103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:02.989396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:03.106382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:03.109836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:03.111353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 956/1905] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:03.124607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:03.127066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:03.155354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293b38-7010-4fbf-9208-cc3319d147d4 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:03.242749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:03.244055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:03.244517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:03.245001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:03.247056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:03.278371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa06a-823e-48ae-bb47-58a2bff1a589 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:03.291978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:03.292701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:03.293006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:03.293416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:03.312605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:03.314713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:03.329123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 957/1906] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:03.336998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:03.338547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:03.356500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 950/1907] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:03.844537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:03.846118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:03.877198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f6f94-e827-4d89-a355-1abb53e8c6a6 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:03.889033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:03.889931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:03.890214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:03.890496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] PATH_INFO: `/v3/projects/d3bb754fe26249ebabf01c8d9f27b2b3` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:03.896351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bb754fe26249ebabf01c8d9f27b2b3)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:03.914473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:03.977642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:03.979989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:04.011472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b4a77-74a3-461f-8947-1d7d4824efac service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:04.034491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:04.035678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:04.036168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:04.036619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] PATH_INFO: `/v3/users/180faa503e054212bd227de8296d71c8` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:04.041192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=180faa503e054212bd227de8296d71c8)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:04.051789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:04.086752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bb754fe26249ebabf01c8d9f27b2b3', 'request_id': 'req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.116944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bb754fe26249ebabf01c8d9f27b2b3', 'request_id': 'req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.132901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bb754fe26249ebabf01c8d9f27b2b3', 'request_id': 'req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.161471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] The token cache is being invalidate because project d3bb754fe26249ebabf01c8d9f27b2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:04.163122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.164216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.167868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 958/1908] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:03 2022] DELETE /identity/v3/projects/d3bb754fe26249ebabf01c8d9f27b2b3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:04.171553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:04.174179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:04.178514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180faa503e054212bd227de8296d71c8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.179853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180faa503e054212bd227de8296d71c8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.192305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180faa503e054212bd227de8296d71c8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.210250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180faa503e054212bd227de8296d71c8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.219739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-25739d1e-2ce0-4b46-9a80-5d0bddddaa56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180faa503e054212bd227de8296d71c8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.228557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 951/1909] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:03 2022] DELETE /identity/v3/users/180faa503e054212bd227de8296d71c8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:04.232993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:04.233862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:04.234690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:04.257782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:04.259366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:04.340286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 952/1910] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:04.368367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1ce82-c35d-42e0-8511-a42fce0d4ddc admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:04.377332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:04.378889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:04.379170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:04.381542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] PATH_INFO: `/v3/users/3331cd07b95844c79643ddd3380704b6` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:04.384023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:04.384747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3331cd07b95844c79643ddd3380704b6)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:04.386154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:04.389547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:04.506007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3331cd07b95844c79643ddd3380704b6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.506834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3331cd07b95844c79643ddd3380704b6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.536659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3331cd07b95844c79643ddd3380704b6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.538613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2aa3-4762-442d-be1c-63e010232e65 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:04.545151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:04.545866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:04.546067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:04.546344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:04.550582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:04.556823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3331cd07b95844c79643ddd3380704b6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.570222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3331cd07b95844c79643ddd3380704b6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:04.570793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:04.572898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:04.580146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 959/1911] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:04 2022] DELETE /identity/v3/users/3331cd07b95844c79643ddd3380704b6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:04.586147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 953/1912] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:04.993588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:04.996912 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.077847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aeef8-b6fa-49a6-8644-a10709fcf22d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:05.085508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:05.086205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.086489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.086906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.090706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.183107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:05.186886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.217826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d50df-0c21-44e1-bfcb-d61681666762 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:05.242763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:05.245048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:05.256640 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 960/1913] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:05.257362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:05.260496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.316982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:05.317870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.318148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.318427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] PATH_INFO: `/v3/projects/e8023df5f0804d37a69712e4c9f77ca8` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.319692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8023df5f0804d37a69712e4c9f77ca8)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:05.321706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:05.341922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6196c3-b023-43df-bc0b-3073c08ea9ac service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:05.346904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:05.347962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.348250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.348522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] PATH_INFO: `/v3/projects/a987af8847854e2d873272fc078c20ab` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.349865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a987af8847854e2d873272fc078c20ab)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:05.366865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:05.397663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8023df5f0804d37a69712e4c9f77ca8', 'request_id': 'req-a556271b-86b5-4f4f-9c9d-9084dd072aac'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.423060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8023df5f0804d37a69712e4c9f77ca8', 'request_id': 'req-a556271b-86b5-4f4f-9c9d-9084dd072aac'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.432884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8023df5f0804d37a69712e4c9f77ca8', 'request_id': 'req-a556271b-86b5-4f4f-9c9d-9084dd072aac'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.451289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] The token cache is being invalidate because project e8023df5f0804d37a69712e4c9f77ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:05.451678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a987af8847854e2d873272fc078c20ab', 'request_id': 'req-abfaee90-8bf0-438a-afcf-a07e19bb4380'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.452484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.453746 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.456770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 954/1914] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:05 2022] DELETE /identity/v3/projects/e8023df5f0804d37a69712e4c9f77ca8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:05.460770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:05.462851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.464450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a987af8847854e2d873272fc078c20ab', 'request_id': 'req-abfaee90-8bf0-438a-afcf-a07e19bb4380'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.476221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a987af8847854e2d873272fc078c20ab', 'request_id': 'req-abfaee90-8bf0-438a-afcf-a07e19bb4380'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.490896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] The token cache is being invalidate because project a987af8847854e2d873272fc078c20ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:05.491217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.491891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-abfaee90-8bf0-438a-afcf-a07e19bb4380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.497242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 961/1915] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:05 2022] DELETE /identity/v3/projects/a987af8847854e2d873272fc078c20ab => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:05.500065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68e4c3-5ea8-4434-8f58-d81e86cd5e56 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.500526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68e4c3-5ea8-4434-8f58-d81e86cd5e56 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.501950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68e4c3-5ea8-4434-8f58-d81e86cd5e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.526189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ff68e4c3-5ea8-4434-8f58-d81e86cd5e56 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:05.527638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ff68e4c3-5ea8-4434-8f58-d81e86cd5e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.552665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556271b-86b5-4f4f-9c9d-9084dd072aac admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:05.608406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 962/1916] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:05.616631 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da86389-6eae-410d-ad03-cc73a220d095 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.617150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da86389-6eae-410d-ad03-cc73a220d095 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.617605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da86389-6eae-410d-ad03-cc73a220d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.652232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-2da86389-6eae-410d-ad03-cc73a220d095 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:05.653767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2da86389-6eae-410d-ad03-cc73a220d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.662840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:05.663744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.664028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.664308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] PATH_INFO: `/v3/users/ea535574e01d42fb8cc224b7b64c5cc8` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.665598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea535574e01d42fb8cc224b7b64c5cc8)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:05.667247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 963/1917] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:05.667825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:05.670911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da86389-6eae-410d-ad03-cc73a220d095 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:05.683500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da86389-6eae-410d-ad03-cc73a220d095 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:05.690384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:05.691516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.691859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.692138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.693833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:05.694335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:05.697157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:05.716750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 964/1918] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:05.720298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:05.724886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea535574e01d42fb8cc224b7b64c5cc8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.725665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea535574e01d42fb8cc224b7b64c5cc8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.735587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea535574e01d42fb8cc224b7b64c5cc8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.748367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce305b70-416f-412c-9fa6-c9aaa1701ea8 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:05.750862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea535574e01d42fb8cc224b7b64c5cc8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.758818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea535574e01d42fb8cc224b7b64c5cc8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:05.762009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:05.762796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.763143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.763350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.764479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:05.766876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:05.767653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 955/1919] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:05 2022] DELETE /identity/v3/users/ea535574e01d42fb8cc224b7b64c5cc8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:05.797698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 965/1920] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:05 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:05.802162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:05.803611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:05.897298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27111b-28d8-405a-b387-d1d857cb0e7a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:05.978095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:05.978836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:05.979115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:05.979745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:05.980138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:05.982128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.007207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 956/1921] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:05 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:06.011393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.022219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836293-5a36-4ea6-943d-2aa792cd0f48 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.027668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.028351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.028632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.028945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.029682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.031513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.045014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 966/1922] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:06.046314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.056513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55478-4e41-4648-85d4-733fc173d367 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.061168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.061829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.062107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.062378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.063103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.064876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.076470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 957/1923] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:06.080355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.090361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59b63-f7dc-4447-9c49-566137e69521 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.099084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462f82f-9069-4dbb-a2a8-085f81a2a3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.100025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f82f-9069-4dbb-a2a8-085f81a2a3df admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.100310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f82f-9069-4dbb-a2a8-085f81a2a3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.100609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f82f-9069-4dbb-a2a8-085f81a2a3df admin admin] PATH_INFO: `/v3/projects/a523231bbc8c42f9a764cc6c85052727/users/e508d14c1d6b4ae4a952cd7b1a1bc345/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.109464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.112173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.116458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462f82f-9069-4dbb-a2a8-085f81a2a3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a523231bbc8c42f9a764cc6c85052727, user_id=e508d14c1d6b4ae4a952cd7b1a1bc345, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.119021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462f82f-9069-4dbb-a2a8-085f81a2a3df admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.125157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f56579-98b9-4e17-86b0-84c8c062cd91 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.131968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.132962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.133218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.133445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] PATH_INFO: `/v3/projects/9b1feddf08514631b18d25bfe45ad98b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.134669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1feddf08514631b18d25bfe45ad98b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.136577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.149856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 967/1924] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:06 2022] PUT /identity/v3/projects/a523231bbc8c42f9a764cc6c85052727/users/e508d14c1d6b4ae4a952cd7b1a1bc345/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:06.159828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.160119 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.160397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.191298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] MFA Rules not processed for user `e508d14c1d6b4ae4a952cd7b1a1bc345`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:06.192850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.194478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1feddf08514631b18d25bfe45ad98b', 'request_id': 'req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.202321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1feddf08514631b18d25bfe45ad98b', 'request_id': 'req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.210907 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1feddf08514631b18d25bfe45ad98b', 'request_id': 'req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.221440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] The token cache is being invalidate because project 9b1feddf08514631b18d25bfe45ad98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:06.221723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.222418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-851e08b1-7d11-4f53-a7c4-e95b2d3b4ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.224049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 958/1925] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:06 2022] DELETE /identity/v3/projects/9b1feddf08514631b18d25bfe45ad98b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:06.230266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0fc0-b6ba-4b29-b1b5-785fe5a8371e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.230553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0fc0-b6ba-4b29-b1b5-785fe5a8371e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.230833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0fc0-b6ba-4b29-b1b5-785fe5a8371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.248759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-d1db0fc0-b6ba-4b29-b1b5-785fe5a8371e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:06.249979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d1db0fc0-b6ba-4b29-b1b5-785fe5a8371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.269040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 968/1926] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:06.279134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.280755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.333535 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 959/1927] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:06.341869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8c30-0481-4649-b578-2fe28cda9f99 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.342157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8c30-0481-4649-b578-2fe28cda9f99 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.342438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8c30-0481-4649-b578-2fe28cda9f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.357262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ec03-95b0-4761-be01-435bdd95eb16 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.363344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.364068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.364312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.364640 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.365801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c12c8c30-0481-4649-b578-2fe28cda9f99 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:06.367038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c12c8c30-0481-4649-b578-2fe28cda9f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.375960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.376132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 960/1928] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:06.378042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.380549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8c30-0481-4649-b578-2fe28cda9f99 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.388994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 969/1929] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:06.389397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8c30-0481-4649-b578-2fe28cda9f99 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.394189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.394861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.395142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.395416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.396178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:06.396545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.398172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.409184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.410683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.413707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 961/1930] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:59:06.414693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.424274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff40625-2776-48bb-8131-8df3d9177375 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.424966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ec9f-d72b-48c6-a8f8-22929995c1ad service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.433470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.434339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.434466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.434650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.434963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] PATH_INFO: `/v3/users/e508d14c1d6b4ae4a952cd7b1a1bc345` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.435125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.435381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.435660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.436195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e508d14c1d6b4ae4a952cd7b1a1bc345)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.436349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.438195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.438348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.472707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 962/1931] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:06 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:06.474126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.493837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e508d14c1d6b4ae4a952cd7b1a1bc345'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.494655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e508d14c1d6b4ae4a952cd7b1a1bc345'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.506441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e508d14c1d6b4ae4a952cd7b1a1bc345'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.514751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e508d14c1d6b4ae4a952cd7b1a1bc345'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.521948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-41d4ecab-3a8f-47ed-b66f-b1bec3cb6088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e508d14c1d6b4ae4a952cd7b1a1bc345'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:06.527747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 970/1932] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:06 2022] DELETE /identity/v3/users/e508d14c1d6b4ae4a952cd7b1a1bc345 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:06.532100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.532388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.532660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.536999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fa5be-63df-4e59-bce7-f7b73602281c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.549519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:06.550966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.591882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.592708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.593008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.593243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.593976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.595895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.608176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 971/1933] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:06.616370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 963/1934] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:06 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:06.620241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.620383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.621832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.621995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.633814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5377-7d87-4b52-afc7-83cc66dcdb9e admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.639067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.639752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.640046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.640316 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.641081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.642867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.653341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 964/1935] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:06.657227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.666712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f7ec3-fe6e-4069-89eb-b289d8511c22 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.671589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.672247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.672526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.672892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.673621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.675210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.677963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55349c6e-e6f9-4ee7-a24f-d454be26f696 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.682356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f513b44-c125-422b-925d-374487bb5b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.683014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513b44-c125-422b-925d-374487bb5b88 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.683306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513b44-c125-422b-925d-374487bb5b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.683583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513b44-c125-422b-925d-374487bb5b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.687418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 965/1936] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:06.693623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.694484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f513b44-c125-422b-925d-374487bb5b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.696247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f513b44-c125-422b-925d-374487bb5b88 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.703657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30229e-f6fb-49d7-935e-3ea2322ab711 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.707457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 972/1937] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:06.709315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.710264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.710566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.710827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] PATH_INFO: `/v3/projects/c213f3f1142a495887dda776027cb257/users/6f17b865735d4739962943bed1e7da42/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.726686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c213f3f1142a495887dda776027cb257, user_id=6f17b865735d4739962943bed1e7da42, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.729692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.746961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 966/1938] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:06 2022] PUT /identity/v3/projects/c213f3f1142a495887dda776027cb257/users/6f17b865735d4739962943bed1e7da42/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:06.758193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.758536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.758843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.790710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] MFA Rules not processed for user `6f17b865735d4739962943bed1e7da42`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:06.791889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.884219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 973/1939] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:06.897765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:06.899706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:06.963526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11e211-4cf2-4379-a062-8f79ffd4ca41 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:06.968745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0005ab-12c5-41da-b596-73025ad04342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:06.969998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0005ab-12c5-41da-b596-73025ad04342 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:06.970473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0005ab-12c5-41da-b596-73025ad04342 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:06.970820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0005ab-12c5-41da-b596-73025ad04342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:06.982716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0005ab-12c5-41da-b596-73025ad04342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:06.984500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0005ab-12c5-41da-b596-73025ad04342 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:06.995926 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 967/1940] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:07.170392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:07.172123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:07.302976 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17b00-4927-49c4-9e1b-0c11d7b9ed1f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:07.323586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:07.324536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.324891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.325165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] PATH_INFO: `/v3/projects/a523231bbc8c42f9a764cc6c85052727` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.331273 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a523231bbc8c42f9a764cc6c85052727)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:07.335496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:07.417142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a523231bbc8c42f9a764cc6c85052727', 'request_id': 'req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:07.432792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a523231bbc8c42f9a764cc6c85052727', 'request_id': 'req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:07.441915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a523231bbc8c42f9a764cc6c85052727', 'request_id': 'req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:07.465711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] The token cache is being invalidate because project a523231bbc8c42f9a764cc6c85052727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:07.466231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:07.467309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a3cbaf1c-84f5-4b12-ac55-86f831ddebdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:07.473464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 974/1941] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:07 2022] DELETE /identity/v3/projects/a523231bbc8c42f9a764cc6c85052727 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:07.479085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb38b-496c-4e76-86f4-b5d8e0f3a104 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.479587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb38b-496c-4e76-86f4-b5d8e0f3a104 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.479693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb38b-496c-4e76-86f4-b5d8e0f3a104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.498617 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-9f0fb38b-496c-4e76-86f4-b5d8e0f3a104 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:07.499844 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9f0fb38b-496c-4e76-86f4-b5d8e0f3a104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:07.560282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 968/1942] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:07.569210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6334b6-e69c-4e1d-b73d-49e25bc36a2f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.569613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6334b6-e69c-4e1d-b73d-49e25bc36a2f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.569928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6334b6-e69c-4e1d-b73d-49e25bc36a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.589303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-2e6334b6-e69c-4e1d-b73d-49e25bc36a2f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:07.590507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2e6334b6-e69c-4e1d-b73d-49e25bc36a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:07.598924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 975/1943] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:07.603263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb38b-496c-4e76-86f4-b5d8e0f3a104 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:07.612924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb38b-496c-4e76-86f4-b5d8e0f3a104 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:07.617532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:07.618190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.618480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.618784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.619515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:07.619822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:07.621439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:07.633179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 969/1944] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:07.639384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6334b6-e69c-4e1d-b73d-49e25bc36a2f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:07.649246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6334b6-e69c-4e1d-b73d-49e25bc36a2f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:07.654219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:07.654883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.655173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.655459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.656159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:07.658227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:07.687525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 976/1945] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:07 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:07.692065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:07.702455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e720-5a36-4a9e-a27a-b64810a4a614 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:07.762087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:07.762787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.763226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.763506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.764213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:07.766171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:07.787074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 970/1946] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:07 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:07.791046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:07.801478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff54ac-bba1-4658-b4d2-f651aa49a120 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:07.806772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:07.807444 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.807727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.808004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.808791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:07.810437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:07.823361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 977/1947] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:07.826915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:07.838067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f05cdd-b0ba-4712-9d0f-bbdae8b54af0 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:07.844016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adc5a1-3afe-4882-bd28-ce2f99e784ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:07.844593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc5a1-3afe-4882-bd28-ce2f99e784ee admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.844909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc5a1-3afe-4882-bd28-ce2f99e784ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.845206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc5a1-3afe-4882-bd28-ce2f99e784ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.845935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc5a1-3afe-4882-bd28-ce2f99e784ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:07.847515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc5a1-3afe-4882-bd28-ce2f99e784ee admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:07.857846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 971/1948] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:07.862138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:07.872443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c03a-640a-450d-badf-fc567ef7d65f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:07.877710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:07.878629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.878906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.879177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] PATH_INFO: `/v3/projects/37514d34bfe240d5925cc92bba0702f4/users/fae4142d65224d1a9ce76eef7547be46/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.895639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37514d34bfe240d5925cc92bba0702f4, user_id=fae4142d65224d1a9ce76eef7547be46, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:07.898785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:07.912568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 978/1949] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:07 2022] PUT /identity/v3/projects/37514d34bfe240d5925cc92bba0702f4/users/fae4142d65224d1a9ce76eef7547be46/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:07.923539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195e95a-22d2-4aaa-84b3-688ec2674e06 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:07.923830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195e95a-22d2-4aaa-84b3-688ec2674e06 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:07.924112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195e95a-22d2-4aaa-84b3-688ec2674e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:07.952554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1195e95a-22d2-4aaa-84b3-688ec2674e06 None None] MFA Rules not processed for user `fae4142d65224d1a9ce76eef7547be46`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:07.953819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1195e95a-22d2-4aaa-84b3-688ec2674e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:08.020618 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 972/1950] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:08.025588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:08.092395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e780d0-2d0f-498b-a272-217066077339 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:08.097392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:08.098133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.098847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.099140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.099861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:08.101805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:08.133279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 979/1951] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:08 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:08.134768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195e95a-22d2-4aaa-84b3-688ec2674e06 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:08.146244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195e95a-22d2-4aaa-84b3-688ec2674e06 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:08.205290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:08.205980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.206262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.206536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.207238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:08.209182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:08.233099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 973/1952] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:08 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:08.234169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:08.244663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d0cf6-4a29-4a94-a49a-ec815707bea7 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:08.250573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:08.251621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.251897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.252307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.253077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:08.254779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:08.266379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 980/1953] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:08.273670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:08.283989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e67ee3-9330-4250-ae58-e53470c912e3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:08.289053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:08.289975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.290849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.291127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] PATH_INFO: `/v3/projects/c37ef3e8239c40d88ea23add56566d6a/users/9807cb9fcd694474976e8d0e4b26b44c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.308456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37ef3e8239c40d88ea23add56566d6a, user_id=9807cb9fcd694474976e8d0e4b26b44c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:08.310837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:08.325443 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 974/1954] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:08 2022] PUT /identity/v3/projects/c37ef3e8239c40d88ea23add56566d6a/users/9807cb9fcd694474976e8d0e4b26b44c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:08.329376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:08.340980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba04b-4410-4553-ab96-bfc795094bd5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:08.403049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244b8da-be51-4d2f-b9b6-f69a3e1ee2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:08.403934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244b8da-be51-4d2f-b9b6-f69a3e1ee2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.404340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244b8da-be51-4d2f-b9b6-f69a3e1ee2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.404753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244b8da-be51-4d2f-b9b6-f69a3e1ee2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.405663 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244b8da-be51-4d2f-b9b6-f69a3e1ee2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:08.407392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244b8da-be51-4d2f-b9b6-f69a3e1ee2f8 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:08.418844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 981/1955] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:08.423364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:08.437303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bedede-47b0-4535-a70f-7add1ce74d67 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:08.443747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:08.444925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.445298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.445666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] PATH_INFO: `/v3/projects/c37ef3e8239c40d88ea23add56566d6a/users/9807cb9fcd694474976e8d0e4b26b44c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.447846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37ef3e8239c40d88ea23add56566d6a, user_id=9807cb9fcd694474976e8d0e4b26b44c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:08.451265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:08.469852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 975/1956] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:08 2022] PUT /identity/v3/projects/c37ef3e8239c40d88ea23add56566d6a/users/9807cb9fcd694474976e8d0e4b26b44c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:08.483497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.483808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.484199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.522727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] MFA Rules not processed for user `9807cb9fcd694474976e8d0e4b26b44c`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:08.524298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:08.650422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 982/1957] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:08.667786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:08.670191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:08.740183 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3e49d-138f-4f9e-b32f-9bf53a74ad79 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:08.746781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adb445-b3f2-497f-97cf-023e23e4b274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:08.747682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adb445-b3f2-497f-97cf-023e23e4b274 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:08.747968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adb445-b3f2-497f-97cf-023e23e4b274 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:08.748295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adb445-b3f2-497f-97cf-023e23e4b274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:08.815015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adb445-b3f2-497f-97cf-023e23e4b274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:08.816707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adb445-b3f2-497f-97cf-023e23e4b274 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:08.826699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 976/1958] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:09.723752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:09.725261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:09.797760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b3749-edc4-4dce-a9cd-15a1bbebdcf8 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:09.802415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:09.803305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:09.803585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:09.803858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] PATH_INFO: `/v3/users/6f17b865735d4739962943bed1e7da42` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:09.805114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f17b865735d4739962943bed1e7da42)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:09.807052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:09.854811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f17b865735d4739962943bed1e7da42'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:09.855526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f17b865735d4739962943bed1e7da42'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:09.869831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f17b865735d4739962943bed1e7da42'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:09.878796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f17b865735d4739962943bed1e7da42'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:09.887496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f17b865735d4739962943bed1e7da42'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:09.893978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 983/1959] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:09 2022] DELETE /identity/v3/users/6f17b865735d4739962943bed1e7da42 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:09.898426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:09.899847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:09.900130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:09.923334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:09.925602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.003997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 977/1960] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:10.013706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.015176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.076833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce303af8-5c2a-4496-acb2-a00ebfd098ae admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.082137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.083076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.083405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.083895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.096103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.098826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.108648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 984/1961] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:10.296814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.298973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.318653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b054-b853-4894-8cf1-cd24cff5f3ef None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.327187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.327879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.328314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.328615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] PATH_INFO: `/v3/users/b5d749aa41c642b1a652bbdca3dda7e8` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.330855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d749aa41c642b1a652bbdca3dda7e8)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.333055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.399859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d749aa41c642b1a652bbdca3dda7e8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.400516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d749aa41c642b1a652bbdca3dda7e8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.408479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d749aa41c642b1a652bbdca3dda7e8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.422497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d749aa41c642b1a652bbdca3dda7e8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.431865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-64b37037-e6de-4115-bba7-fca0aff14b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d749aa41c642b1a652bbdca3dda7e8'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.439887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.441813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.443027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 978/1962] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:10 2022] DELETE /identity/v3/users/b5d749aa41c642b1a652bbdca3dda7e8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:10.447282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.452824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.453981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.456117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8c0da-6bb7-4f7b-bfd7-7a44d5da8a38 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.473103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:10.474319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.520044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.521112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.521492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.522041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] PATH_INFO: `/v3/projects/c213f3f1142a495887dda776027cb257` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.523277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c213f3f1142a495887dda776027cb257)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.525298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.533974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 979/1963] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:10.543742 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.545157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.573167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c213f3f1142a495887dda776027cb257', 'request_id': 'req-ff27685c-fe5c-453b-ae5e-d53c300f50c6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.580498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c213f3f1142a495887dda776027cb257', 'request_id': 'req-ff27685c-fe5c-453b-ae5e-d53c300f50c6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.587748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c213f3f1142a495887dda776027cb257', 'request_id': 'req-ff27685c-fe5c-453b-ae5e-d53c300f50c6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.597998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] The token cache is being invalidate because project c213f3f1142a495887dda776027cb257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:10.598340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.598970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ff27685c-fe5c-453b-ae5e-d53c300f50c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:10.600694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 985/1964] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:10 2022] DELETE /identity/v3/projects/c213f3f1142a495887dda776027cb257 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:10.603032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa21a1-4388-4378-b959-38883fbdbe38 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.605656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c00db-dae9-4147-9209-023a3028686d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.605992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c00db-dae9-4147-9209-023a3028686d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.606326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c00db-dae9-4147-9209-023a3028686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.625152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4a5c00db-dae9-4147-9209-023a3028686d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:10.626734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4a5c00db-dae9-4147-9209-023a3028686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.653866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.654525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.654812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.655100 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.656930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.694684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 986/1965] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:10.697438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ad5fe-d4d6-4ea7-abdb-5817d044abcb None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.697779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ad5fe-d4d6-4ea7-abdb-5817d044abcb None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.698060 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ad5fe-d4d6-4ea7-abdb-5817d044abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.719418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8b8ad5fe-d4d6-4ea7-abdb-5817d044abcb None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:10.720896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8b8ad5fe-d4d6-4ea7-abdb-5817d044abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:10.722813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.724554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.730482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 987/1966] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:10.734409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ad5fe-d4d6-4ea7-abdb-5817d044abcb None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.735721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 980/1967] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:10.743443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ad5fe-d4d6-4ea7-abdb-5817d044abcb None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.748319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.749028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.749311 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.749586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.750324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:10.750627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.752649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.765147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 988/1968] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:59:10.770290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.780068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c296d-e253-4025-8df0-6f08ae1db363 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.786288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.786998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.787283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.787562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.788269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.790222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.828817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 981/1969] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:10 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:10.833062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.843184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e8240-6850-4250-8b53-15f9d463c1f9 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.924150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.924150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.924392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.924806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.925511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.927790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.955557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 989/1970] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:10 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:10.959431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:10.970323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee064-623b-4ed2-b064-bf1c046645a5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:10.975387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:10.976098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:10.976378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:10.976657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:10.977430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:10.979032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:10.994276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 982/1971] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:10.998214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.008966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b9835-a147-4362-a2a5-cb2e3478a4b4 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.014204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.014877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.015163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.015431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.016336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.018102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.029748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 990/1972] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:11.040767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.051352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.052269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e541-db0d-4660-8736-a38e6c6bf5fc admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.057338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.059089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c701f21-e8e5-4937-b84b-31d93bbc46ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.060024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c701f21-e8e5-4937-b84b-31d93bbc46ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.060481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c701f21-e8e5-4937-b84b-31d93bbc46ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.060810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c701f21-e8e5-4937-b84b-31d93bbc46ad admin admin] PATH_INFO: `/v3/projects/f4edc9bcf730480487f8be6915d32af9/users/2a43441e07024369b3b85c21d438ef51/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.077992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c701f21-e8e5-4937-b84b-31d93bbc46ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4edc9bcf730480487f8be6915d32af9, user_id=2a43441e07024369b3b85c21d438ef51, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.080753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c701f21-e8e5-4937-b84b-31d93bbc46ad admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.089045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d1128-2fa3-4f40-98d7-5aa972c5de18 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.095696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.096614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.096928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.097212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] PATH_INFO: `/v3/projects/46ad3099cd7b4b6f8f6c8f9f4cfa87d9` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.098504 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ad3099cd7b4b6f8f6c8f9f4cfa87d9)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.099675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 983/1973] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:11 2022] PUT /identity/v3/projects/f4edc9bcf730480487f8be6915d32af9/users/2a43441e07024369b3b85c21d438ef51/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:11.104806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.110478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.110952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.111254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.142255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] MFA Rules not processed for user `2a43441e07024369b3b85c21d438ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:11.143753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.154282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ad3099cd7b4b6f8f6c8f9f4cfa87d9', 'request_id': 'req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.163146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ad3099cd7b4b6f8f6c8f9f4cfa87d9', 'request_id': 'req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.170700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ad3099cd7b4b6f8f6c8f9f4cfa87d9', 'request_id': 'req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.183992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] The token cache is being invalidate because project 46ad3099cd7b4b6f8f6c8f9f4cfa87d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:11.184260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.184970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.186881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 991/1974] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:11 2022] DELETE /identity/v3/projects/46ad3099cd7b4b6f8f6c8f9f4cfa87d9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:11.190742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.192448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.216217 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 984/1975] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:11.231465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.233157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.260427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa514fa5-fcf1-4c9c-84e3-59eb9b7549e2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.265178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.266067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.266351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.266629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] PATH_INFO: `/v3/users/3c583f470062449c894c3017a39f3d38` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.268068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c583f470062449c894c3017a39f3d38)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.270231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.289366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcb2f1-03be-4732-aae6-3a05f6112e4e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.293257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.293939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.294312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.294865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.305902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.307424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.316401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 985/1976] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:11.318162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c583f470062449c894c3017a39f3d38'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.318821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c583f470062449c894c3017a39f3d38'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.331784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c583f470062449c894c3017a39f3d38'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.339700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c583f470062449c894c3017a39f3d38'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.344165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.345718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.346948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c583f470062449c894c3017a39f3d38'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.353190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 992/1977] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:11 2022] DELETE /identity/v3/users/3c583f470062449c894c3017a39f3d38 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:11.363428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5848f-904f-4e35-a8fa-a11363d20840 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.400050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.401556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.438958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.440014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.440298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.440653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] PATH_INFO: `/v3/users/2a43441e07024369b3b85c21d438ef51` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.441941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a43441e07024369b3b85c21d438ef51)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.444027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.480113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bae082-5d04-4268-96a7-36e0c5d18f4d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.484959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.485853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.486167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.486526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] PATH_INFO: `/v3/users/fae4142d65224d1a9ce76eef7547be46` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.488021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae4142d65224d1a9ce76eef7547be46)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.490315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.503583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a43441e07024369b3b85c21d438ef51'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.504259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a43441e07024369b3b85c21d438ef51'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.513684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a43441e07024369b3b85c21d438ef51'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.538418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a43441e07024369b3b85c21d438ef51'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.545537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6d6171f3-5371-4bfc-93c4-0ea7c111267f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a43441e07024369b3b85c21d438ef51'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.551814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 986/1978] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:11 2022] DELETE /identity/v3/users/2a43441e07024369b3b85c21d438ef51 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:11.553565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae4142d65224d1a9ce76eef7547be46'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.554242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae4142d65224d1a9ce76eef7547be46'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.556173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.556533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.556933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.568907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae4142d65224d1a9ce76eef7547be46'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.575121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:11.576623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.577589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae4142d65224d1a9ce76eef7547be46'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.585364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-da36913f-6b0e-40b5-b6e9-953c7b5e43c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae4142d65224d1a9ce76eef7547be46'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.592576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 993/1979] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:11 2022] DELETE /identity/v3/users/fae4142d65224d1a9ce76eef7547be46 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:11.597266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.597643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.597996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.615849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:11.617201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.638920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 987/1980] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:11.650649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.652198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.685658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 994/1981] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:11.686337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.687625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.699438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3d77d-d04c-4698-9784-fba77a6c5b96 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.704245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.705258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.705535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.705807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] PATH_INFO: `/v3/projects/7d9440d290ac4c5eaa5369ebf7dc21b1` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.706977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9440d290ac4c5eaa5369ebf7dc21b1)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.708929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.717109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde6bf4-d4f3-4aee-8955-ae291abff628 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.754565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9440d290ac4c5eaa5369ebf7dc21b1', 'request_id': 'req-296b182c-31c1-40f0-953b-9aac068be75d'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.763538 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9440d290ac4c5eaa5369ebf7dc21b1', 'request_id': 'req-296b182c-31c1-40f0-953b-9aac068be75d'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.770272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9440d290ac4c5eaa5369ebf7dc21b1', 'request_id': 'req-296b182c-31c1-40f0-953b-9aac068be75d'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.771772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10615c6-c8a0-45e8-858e-d42f55ea77c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.772438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10615c6-c8a0-45e8-858e-d42f55ea77c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.772753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10615c6-c8a0-45e8-858e-d42f55ea77c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.773065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10615c6-c8a0-45e8-858e-d42f55ea77c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.780389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] The token cache is being invalidate because project 7d9440d290ac4c5eaa5369ebf7dc21b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:11.780697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.781432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:11.782307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10615c6-c8a0-45e8-858e-d42f55ea77c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.783057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 995/1982] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:11 2022] DELETE /identity/v3/projects/7d9440d290ac4c5eaa5369ebf7dc21b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:11.783941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10615c6-c8a0-45e8-858e-d42f55ea77c1 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.784080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.785305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.794026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 988/1983] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:11.795303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76954d-f735-46e1-a651-7b77925e675a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.795579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76954d-f735-46e1-a651-7b77925e675a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.795859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76954d-f735-46e1-a651-7b77925e675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.814301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ab76954d-f735-46e1-a651-7b77925e675a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:11.815772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ab76954d-f735-46e1-a651-7b77925e675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.851286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b182c-31c1-40f0-953b-9aac068be75d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.855389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.856285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.856574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.856901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.859218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.884494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 989/1984] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:11.892991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f8d1-92f9-4ef1-8a0e-df2b14b0bbec None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.893604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f8d1-92f9-4ef1-8a0e-df2b14b0bbec None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.893945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f8d1-92f9-4ef1-8a0e-df2b14b0bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.916582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5a18f8d1-92f9-4ef1-8a0e-df2b14b0bbec None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:11.917924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5a18f8d1-92f9-4ef1-8a0e-df2b14b0bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:11.927094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 990/1985] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:11.931497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f8d1-92f9-4ef1-8a0e-df2b14b0bbec None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.937116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.938664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.942396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f8d1-92f9-4ef1-8a0e-df2b14b0bbec None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.947518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.948928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.949214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.949490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.950228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:11.950343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 996/1986] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:11.950538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.952227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:11.971085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 991/1987] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:11.972328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:11.982967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a8737-c31d-4bf4-bf66-60a32007944e service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:11.988632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:11.989519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:11.989807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:11.990086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:11.991139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:11.993111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.025155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 997/1988] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:11 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:12.027255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.039289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df2a04-09f3-4828-b0b3-673a499538d2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.099991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.102796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.144108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.145484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.145874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.146222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.147150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.149381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.187898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 992/1989] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:12 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:12.192947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.203573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40995c34-7f49-4d16-a6b9-69b0ac12b1b9 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.209293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.210138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.210567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.211008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.211985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.213766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.222700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b17cc-520d-4b64-b9ca-0f47022d55f1 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.231492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 993/1990] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:12.232418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.233490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.234827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.235605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.237131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] PATH_INFO: `/v3/projects/f4edc9bcf730480487f8be6915d32af9` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.239294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4edc9bcf730480487f8be6915d32af9)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.244005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.250870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7d76-afbd-429d-bf96-b26d60945b20 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.258253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.259110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.259485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.259839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.260620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.262327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.277401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 994/1991] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:12.278351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.281014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.299467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951c130-dd49-416a-96c4-01aa17f1e51c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.305131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.306212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.306592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.306967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] PATH_INFO: `/v3/projects/37514d34bfe240d5925cc92bba0702f4` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.309698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37514d34bfe240d5925cc92bba0702f4)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.312584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.333509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4edc9bcf730480487f8be6915d32af9', 'request_id': 'req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.344313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4edc9bcf730480487f8be6915d32af9', 'request_id': 'req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.351698 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4edc9bcf730480487f8be6915d32af9', 'request_id': 'req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.369271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] The token cache is being invalidate because project f4edc9bcf730480487f8be6915d32af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:12.369570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.370748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.375769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 998/1992] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:12 2022] DELETE /identity/v3/projects/f4edc9bcf730480487f8be6915d32af9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:12.377754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.379965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.389157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37514d34bfe240d5925cc92bba0702f4', 'request_id': 'req-e1c8a656-f51d-45f1-803a-4840bdc4ce19'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.401862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37514d34bfe240d5925cc92bba0702f4', 'request_id': 'req-e1c8a656-f51d-45f1-803a-4840bdc4ce19'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.412762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37514d34bfe240d5925cc92bba0702f4', 'request_id': 'req-e1c8a656-f51d-45f1-803a-4840bdc4ce19'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.430532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] The token cache is being invalidate because project 37514d34bfe240d5925cc92bba0702f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:12.431066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.432063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1c8a656-f51d-45f1-803a-4840bdc4ce19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.437528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 995/1993] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:12 2022] DELETE /identity/v3/projects/37514d34bfe240d5925cc92bba0702f4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:12.438206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.439411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.439926 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.465236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cba64-48a5-4f61-937a-49db9d9ca5c2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.470151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:12.471510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.524032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29851fb3-ee2f-42ed-8e28-67f785cbe03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.525073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29851fb3-ee2f-42ed-8e28-67f785cbe03c admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.525420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29851fb3-ee2f-42ed-8e28-67f785cbe03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.525761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29851fb3-ee2f-42ed-8e28-67f785cbe03c admin admin] PATH_INFO: `/v3/projects/4fe7665f1ecf4c9791551c857c91d4d4/users/295e9d9178d043c4892efd5603c3915f/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.532841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 996/1994] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:12.534708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.536727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.541725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29851fb3-ee2f-42ed-8e28-67f785cbe03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe7665f1ecf4c9791551c857c91d4d4, user_id=295e9d9178d043c4892efd5603c3915f, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.544492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29851fb3-ee2f-42ed-8e28-67f785cbe03c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.550566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b465a-74eb-4931-bd2a-e58e72e6619b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.556357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.557474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.557792 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.558162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] PATH_INFO: `/v3/users/9807cb9fcd694474976e8d0e4b26b44c` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.559491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9807cb9fcd694474976e8d0e4b26b44c)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.560701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 999/1995] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:12 2022] PUT /identity/v3/projects/4fe7665f1ecf4c9791551c857c91d4d4/users/295e9d9178d043c4892efd5603c3915f/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:12.561715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.566811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922d20-4ca2-4e68-989b-eb2d5bd9d535 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.567519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922d20-4ca2-4e68-989b-eb2d5bd9d535 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.567962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922d20-4ca2-4e68-989b-eb2d5bd9d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.588660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-0c922d20-4ca2-4e68-989b-eb2d5bd9d535 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:12.590030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0c922d20-4ca2-4e68-989b-eb2d5bd9d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.613301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9807cb9fcd694474976e8d0e4b26b44c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.614019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9807cb9fcd694474976e8d0e4b26b44c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.622997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9807cb9fcd694474976e8d0e4b26b44c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.638709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9807cb9fcd694474976e8d0e4b26b44c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.646402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4065dee-dc3c-457c-8b4e-4f3d24bc3310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9807cb9fcd694474976e8d0e4b26b44c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:12.653606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 997/1996] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:12 2022] DELETE /identity/v3/users/9807cb9fcd694474976e8d0e4b26b44c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:12.654469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1000/1997] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:12.655519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.655897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.656275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.658717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922d20-4ca2-4e68-989b-eb2d5bd9d535 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.671337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922d20-4ca2-4e68-989b-eb2d5bd9d535 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.695579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] MFA Rules not processed for user `295e9d9178d043c4892efd5603c3915f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:12.697145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.735630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.736188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.736610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.736916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.737718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:12.738049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.739723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.755370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1001/1998] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:59:12.759487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.773076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7321a7-efd4-433f-a4c4-79d285b55596 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.774647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 998/1999] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:12.778835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.779827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.780156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.780493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.781234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.783615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.786423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.787822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:12.821684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1002/2000] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:12 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:12.826350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.882087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece739-8a9f-4e0e-b36c-0e241512dd2b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.915386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282aafd-c5cb-4317-942d-25d8195da2e7 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.922749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.923505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.924260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.924718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.925609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:12.928576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:12.965028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.965728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.966007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.966567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.968632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1003/2001] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:12 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:12.973007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:12.985842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1c95b-7596-4173-82f2-06f207ba60e3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:12.995025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:12.997350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:12.997798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:12.999044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:12.999975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.002243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.021908 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1004/2002] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:13.022996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.025759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.037568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.042040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.044287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c79374-d2f1-488f-9045-7d0e6554fb92 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.049236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.050265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.050551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.050827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] PATH_INFO: `/v3/projects/c37ef3e8239c40d88ea23add56566d6a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.051544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 999/2003] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:13.052450 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.053356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37ef3e8239c40d88ea23add56566d6a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.055319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.063743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88540-43ca-4d75-9ea9-ac42b187fe01 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.072898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.073579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.073868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.074135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.074872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.076516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.087253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1000/2004] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:13.087253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.087253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.103764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37ef3e8239c40d88ea23add56566d6a', 'request_id': 'req-7be106f8-eb9d-496e-8e68-e7e62809475f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.104266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62b582-ca89-413e-b1f0-b172d4c69a53 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.112384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37ef3e8239c40d88ea23add56566d6a', 'request_id': 'req-7be106f8-eb9d-496e-8e68-e7e62809475f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.120648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37ef3e8239c40d88ea23add56566d6a', 'request_id': 'req-7be106f8-eb9d-496e-8e68-e7e62809475f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.131425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] The token cache is being invalidate because project c37ef3e8239c40d88ea23add56566d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:13.131707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.132363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.134184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1005/2005] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:13 2022] DELETE /identity/v3/projects/c37ef3e8239c40d88ea23add56566d6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:13.134941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.136207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.173030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.174187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.174545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.174887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] PATH_INFO: `/v3/users/0b5b19eaf0f946a9a0d531badc8a0bae` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.176307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5b19eaf0f946a9a0d531badc8a0bae)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.178463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.205282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be106f8-eb9d-496e-8e68-e7e62809475f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.211701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.211987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.212183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.212458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] PATH_INFO: `/v3/users/295e9d9178d043c4892efd5603c3915f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.213931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295e9d9178d043c4892efd5603c3915f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.216137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.236348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5b19eaf0f946a9a0d531badc8a0bae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.237337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5b19eaf0f946a9a0d531badc8a0bae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.247271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5b19eaf0f946a9a0d531badc8a0bae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.262456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5b19eaf0f946a9a0d531badc8a0bae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.270795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5b19eaf0f946a9a0d531badc8a0bae'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.271730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295e9d9178d043c4892efd5603c3915f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.272821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295e9d9178d043c4892efd5603c3915f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.277459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1001/2006] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:13 2022] DELETE /identity/v3/users/0b5b19eaf0f946a9a0d531badc8a0bae => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:13.278306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.279913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.296629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295e9d9178d043c4892efd5603c3915f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.309447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295e9d9178d043c4892efd5603c3915f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.320984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6cee58b5-c2aa-42f7-95ed-d198cc84c687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295e9d9178d043c4892efd5603c3915f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.334889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1006/2007] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:13 2022] DELETE /identity/v3/users/295e9d9178d043c4892efd5603c3915f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:13.336298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.336582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.337353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.355391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:13.357237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef8dd4-b277-4da3-b0fb-bed2f74ab313 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.357513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.412343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.413298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.413577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.413883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] PATH_INFO: `/v3/projects/427cd0f319be456785a3dd74e76af977/users/7afa6d07275d44a5b1ae627752b0d552/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.419290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1007/2008] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:13.429925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.431447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.437766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=427cd0f319be456785a3dd74e76af977, user_id=7afa6d07275d44a5b1ae627752b0d552, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.440501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.458500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1002/2009] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:13 2022] PUT /identity/v3/projects/427cd0f319be456785a3dd74e76af977/users/7afa6d07275d44a5b1ae627752b0d552/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:13.468637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.470737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.526831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde73417-4135-4ec3-93a7-1dc19135938c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.546235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cfab7-4bd7-43b1-a4f0-8e6e1d3f89e2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.552264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.553275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.553632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.553985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] PATH_INFO: `/v3/projects/78dc305288844d31b96ce03cca84d0de` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.555293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] RBAC: Authorizing `identity:delete_project(project_id=78dc305288844d31b96ce03cca84d0de)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.557636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.589242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf6b65-e1e8-4fdc-8bca-8f16fde47cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.590290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6b65-e1e8-4fdc-8bca-8f16fde47cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.590815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6b65-e1e8-4fdc-8bca-8f16fde47cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.591266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6b65-e1e8-4fdc-8bca-8f16fde47cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.602081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf6b65-e1e8-4fdc-8bca-8f16fde47cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.604236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf6b65-e1e8-4fdc-8bca-8f16fde47cf3 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.615477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1008/2010] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:13.617114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.617706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.618082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.650367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] MFA Rules not processed for user `7afa6d07275d44a5b1ae627752b0d552`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:13.652032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.664609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78dc305288844d31b96ce03cca84d0de', 'request_id': 'req-3757b2e7-5e6a-44fa-a808-682c312abcee'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.682207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78dc305288844d31b96ce03cca84d0de', 'request_id': 'req-3757b2e7-5e6a-44fa-a808-682c312abcee'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.693567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78dc305288844d31b96ce03cca84d0de', 'request_id': 'req-3757b2e7-5e6a-44fa-a808-682c312abcee'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.707270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] The token cache is being invalidate because project 78dc305288844d31b96ce03cca84d0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:13.708264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.709137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3757b2e7-5e6a-44fa-a808-682c312abcee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:13.711557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1003/2011] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:13 2022] DELETE /identity/v3/projects/78dc305288844d31b96ce03cca84d0de => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:13.716437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91669-fe43-46ed-a491-4ad32f5c3c20 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.716807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91669-fe43-46ed-a491-4ad32f5c3c20 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.717089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91669-fe43-46ed-a491-4ad32f5c3c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.742322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1fa91669-fe43-46ed-a491-4ad32f5c3c20 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:13.743822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1fa91669-fe43-46ed-a491-4ad32f5c3c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.760464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1009/2012] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:13.771464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.773035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.842906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1004/2013] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:13.850046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd32a-96ab-4756-968f-49460eef5bcb None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.850406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd32a-96ab-4756-968f-49460eef5bcb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.850737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd32a-96ab-4756-968f-49460eef5bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.870139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2580d35-7e78-4a56-b5ba-78cb2b8b5b58 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.874613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.874847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ae9cd32a-96ab-4756-968f-49460eef5bcb None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:13.875653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.876575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.876713 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ae9cd32a-96ab-4756-968f-49460eef5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.877145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.886317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1005/2014] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:13.889102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.890889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cd32a-96ab-4756-968f-49460eef5bcb None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.891347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.901644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cd32a-96ab-4756-968f-49460eef5bcb None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.902596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1010/2015] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:13.909600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.910823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.910823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.911196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.912099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:13.912475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.914203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.930528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1006/2016] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:59:13.931901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.957082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b1a0c-bea5-40f3-b967-a73c0618c714 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:13.965287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:13.965958 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:13.966240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:13.966514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:13.967294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:13.969581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:13.972637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:13.974440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:13.998741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657176-3d49-4e7b-91d0-f96b928e4928 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.005821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.006803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.007139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.007546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] PATH_INFO: `/v3/projects/4fe7665f1ecf4c9791551c857c91d4d4` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.008874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe7665f1ecf4c9791551c857c91d4d4)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.011370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.019717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1011/2017] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:13 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:14.024109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.067529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe7665f1ecf4c9791551c857c91d4d4', 'request_id': 'req-493b33fc-c15e-47f7-b797-334e96edbcb1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:14.076957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe7665f1ecf4c9791551c857c91d4d4', 'request_id': 'req-493b33fc-c15e-47f7-b797-334e96edbcb1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:14.086565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe7665f1ecf4c9791551c857c91d4d4', 'request_id': 'req-493b33fc-c15e-47f7-b797-334e96edbcb1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:14.096425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65615a2-2069-43e5-b5b9-b901ba3b9fd0 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.099431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] The token cache is being invalidate because project 4fe7665f1ecf4c9791551c857c91d4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:14.099820 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:14.100572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-493b33fc-c15e-47f7-b797-334e96edbcb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:14.102399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1007/2018] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:13 2022] DELETE /identity/v3/projects/4fe7665f1ecf4c9791551c857c91d4d4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:14.107170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfdbcc-793a-4649-a060-64dbeb66236a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.107457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfdbcc-793a-4649-a060-64dbeb66236a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.107735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfdbcc-793a-4649-a060-64dbeb66236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.130910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-17dfdbcc-793a-4649-a060-64dbeb66236a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:14.132128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-17dfdbcc-793a-4649-a060-64dbeb66236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:14.165847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.166387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.166685 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.167013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.167697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.169736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.205437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1008/2019] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:14.210409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1012/2020] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:14 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:14.213544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b269-55ac-4c00-ae40-15921760ad04 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.214047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b269-55ac-4c00-ae40-15921760ad04 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.214152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.214643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20b269-55ac-4c00-ae40-15921760ad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.215851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:14.228566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36efc-348e-4f8c-8625-44fce02a6016 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.233712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.234569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.234907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.235101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.235835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.237373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5d20b269-55ac-4c00-ae40-15921760ad04 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:14.237660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.238814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5d20b269-55ac-4c00-ae40-15921760ad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:14.249256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1013/2021] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:14.253492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.258295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1009/2022] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:14.259406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20b269-55ac-4c00-ae40-15921760ad04 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.263723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2ab7-88ca-4a13-9638-e336c5127338 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.270329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20b269-55ac-4c00-ae40-15921760ad04 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.270472 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.271257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.271640 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.272004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.272970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.274600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.275096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.275767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.276051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.276340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.277101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:14.277416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.279006 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.287957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1014/2023] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:14.291194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1010/2024] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:14.292263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.296557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.302427 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04fb66-92bc-44f5-ba1f-e01a0eaee659 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.306077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabb543-6577-4f0d-9a3d-2aa1e0cb9fbb admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.307283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6667553-8850-4497-8a2b-b5bed5f4ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.308277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6667553-8850-4497-8a2b-b5bed5f4ccb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.308555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6667553-8850-4497-8a2b-b5bed5f4ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.308864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6667553-8850-4497-8a2b-b5bed5f4ccb6 admin admin] PATH_INFO: `/v3/projects/d27667694cf7435dac925a99cb974d24/users/a77bea39184944f7ad3215e289cba3df/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.310596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.311246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.311528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.311812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.312491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.314484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.323845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6667553-8850-4497-8a2b-b5bed5f4ccb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27667694cf7435dac925a99cb974d24, user_id=a77bea39184944f7ad3215e289cba3df, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.326494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6667553-8850-4497-8a2b-b5bed5f4ccb6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.340170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1015/2025] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:14 2022] PUT /identity/v3/projects/d27667694cf7435dac925a99cb974d24/users/a77bea39184944f7ad3215e289cba3df/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:14.349729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1011/2026] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:14 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:14.350495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982769d1-c2ed-4dd4-8bf7-74ab6f1c37dc None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.350811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982769d1-c2ed-4dd4-8bf7-74ab6f1c37dc None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.351139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982769d1-c2ed-4dd4-8bf7-74ab6f1c37dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.353576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.376806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-982769d1-c2ed-4dd4-8bf7-74ab6f1c37dc None None] MFA Rules not processed for user `a77bea39184944f7ad3215e289cba3df`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:14.378044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-982769d1-c2ed-4dd4-8bf7-74ab6f1c37dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:14.416963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2805-0111-4f3c-8db5-f9e7cb005c27 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.423106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.423790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.424129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.424408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.425270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.427274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.441058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1016/2027] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:14.451597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1012/2028] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:14 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:14.452800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982769d1-c2ed-4dd4-8bf7-74ab6f1c37dc None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.457673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.459322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:14.463494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982769d1-c2ed-4dd4-8bf7-74ab6f1c37dc None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.468326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.469036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.469321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.470249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.471049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.472653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.482477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1017/2029] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:14.486508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.495730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392cad7-11fd-4fc8-9aff-86530ea80625 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.500308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.500918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.501567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.501900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.502609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.504170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.515507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1018/2030] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:14.519925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.530227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09b7e-09a7-43b0-8ace-3e087c9b2ca6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.530640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87318-ba5f-4690-a98b-a6257a336b7c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.535934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.536697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe8a59-e0a8-4933-afb5-4ab5a13458e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.536864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.537144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.537354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe8a59-e0a8-4933-afb5-4ab5a13458e8 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.537478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] PATH_INFO: `/v3/projects/44d3ac788c374852b0a379711ce47b83/users/36eeb6f3e9e348f7b439253a2d92fc8e/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.537632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe8a59-e0a8-4933-afb5-4ab5a13458e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.537922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe8a59-e0a8-4933-afb5-4ab5a13458e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.545679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe8a59-e0a8-4933-afb5-4ab5a13458e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.547279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe8a59-e0a8-4933-afb5-4ab5a13458e8 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.553218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d3ac788c374852b0a379711ce47b83, user_id=36eeb6f3e9e348f7b439253a2d92fc8e, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.555920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.556830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1013/2031] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:14.570882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1019/2032] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:14 2022] PUT /identity/v3/projects/44d3ac788c374852b0a379711ce47b83/users/36eeb6f3e9e348f7b439253a2d92fc8e/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:14.581390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76cee8-c9c8-4435-9393-fa1d939c6161 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.581742 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76cee8-c9c8-4435-9393-fa1d939c6161 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.582108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76cee8-c9c8-4435-9393-fa1d939c6161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.608036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-9b76cee8-c9c8-4435-9393-fa1d939c6161 None None] MFA Rules not processed for user `36eeb6f3e9e348f7b439253a2d92fc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:14.609325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9b76cee8-c9c8-4435-9393-fa1d939c6161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:14.677436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1014/2033] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:14.688984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:14.691012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:14.759154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97daef-97dd-4501-984e-9b17b51022d3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:14.766651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb800-8331-4efe-abec-9aafee95e385 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:14.767548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb800-8331-4efe-abec-9aafee95e385 service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:14.767998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb800-8331-4efe-abec-9aafee95e385 service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:14.768722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb800-8331-4efe-abec-9aafee95e385 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:14.779539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeb800-8331-4efe-abec-9aafee95e385 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:14.782026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeb800-8331-4efe-abec-9aafee95e385 service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:14.792268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1020/2034] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:28.141024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76cee8-c9c8-4435-9393-fa1d939c6161 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:28.204527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76cee8-c9c8-4435-9393-fa1d939c6161 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:28.210116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:28.211014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:28.211401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:28.211682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] PATH_INFO: `/v3/users/a77bea39184944f7ad3215e289cba3df` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:28.212982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77bea39184944f7ad3215e289cba3df)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:28.214896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:28.263880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77bea39184944f7ad3215e289cba3df'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.264545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77bea39184944f7ad3215e289cba3df'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.272660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77bea39184944f7ad3215e289cba3df'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.283927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77bea39184944f7ad3215e289cba3df'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.290994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77bea39184944f7ad3215e289cba3df'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.296918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1015/2035] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:28 2022] DELETE /identity/v3/users/a77bea39184944f7ad3215e289cba3df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:28.301753 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741471-774b-42ee-b764-c931f5f43099 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:28.302244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741471-774b-42ee-b764-c931f5f43099 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:28.302244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741471-774b-42ee-b764-c931f5f43099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:28.319508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-18741471-774b-42ee-b764-c931f5f43099 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:28.320708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-18741471-774b-42ee-b764-c931f5f43099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:28.381543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1021/2036] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:28.391909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:28.394166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:28.459322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20767-e92a-44ff-a439-a94f61226a93 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:28.463435 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f743-18df-43cf-a431-4df0c571fb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:28.464088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f743-18df-43cf-a431-4df0c571fb28 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:28.464367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f743-18df-43cf-a431-4df0c571fb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:28.464709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f743-18df-43cf-a431-4df0c571fb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:28.475825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7f743-18df-43cf-a431-4df0c571fb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:28.477315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7f743-18df-43cf-a431-4df0c571fb28 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:28.487347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1016/2037] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:28.745774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18741471-774b-42ee-b764-c931f5f43099 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:28.747315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-18741471-774b-42ee-b764-c931f5f43099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:28.760688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18741471-774b-42ee-b764-c931f5f43099 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:28.766243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:28.767130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:28.767412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:28.767688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] PATH_INFO: `/v3/projects/d27667694cf7435dac925a99cb974d24` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:28.769001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27667694cf7435dac925a99cb974d24)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:28.770923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:28.819267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27667694cf7435dac925a99cb974d24', 'request_id': 'req-c853c969-1eb0-4a09-8cbd-19db4aeab602'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.828341 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27667694cf7435dac925a99cb974d24', 'request_id': 'req-c853c969-1eb0-4a09-8cbd-19db4aeab602'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.835062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27667694cf7435dac925a99cb974d24', 'request_id': 'req-c853c969-1eb0-4a09-8cbd-19db4aeab602'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.846936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] The token cache is being invalidate because project d27667694cf7435dac925a99cb974d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:28.847222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.847965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c853c969-1eb0-4a09-8cbd-19db4aeab602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:28.849653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1022/2038] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:28 2022] DELETE /identity/v3/projects/d27667694cf7435dac925a99cb974d24 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:28.854795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1130bd-96c9-438a-89ed-8f5c77761996 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:28.855081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1130bd-96c9-438a-89ed-8f5c77761996 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:28.855363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1130bd-96c9-438a-89ed-8f5c77761996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:28.873992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-af1130bd-96c9-438a-89ed-8f5c77761996 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:28.875196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-af1130bd-96c9-438a-89ed-8f5c77761996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:28.935191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1017/2039] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:28.943132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf983a-a2ec-466d-8886-60bc9b792cdb None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:28.943419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf983a-a2ec-466d-8886-60bc9b792cdb None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:28.943727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf983a-a2ec-466d-8886-60bc9b792cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:28.961949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-3fbf983a-a2ec-466d-8886-60bc9b792cdb None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:28.963152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3fbf983a-a2ec-466d-8886-60bc9b792cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:28.971179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1023/2040] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:28.975519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1130bd-96c9-438a-89ed-8f5c77761996 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:28.985452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1130bd-96c9-438a-89ed-8f5c77761996 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:28.990391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:28.991312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:28.991589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:28.991859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:28.992616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:28.992957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:28.994565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:29.007017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1018/2041] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:29.011546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf983a-a2ec-466d-8886-60bc9b792cdb None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:29.021005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf983a-a2ec-466d-8886-60bc9b792cdb None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:29.026362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:29.027041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:29.027325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:29.027597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:29.028310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:29.030267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:29.057422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1024/2042] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:29 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:29.061522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:29.071663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825ac8b-6eff-4d48-9afc-f59ef365cbb1 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:29.130301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:29.130967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:29.131290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:29.131570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:29.132271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:29.134208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:29.161805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1019/2043] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:29 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:29.166038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:29.176199 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00168c-c710-4504-9052-20cb951ad1a1 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:29.181262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:29.181933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:29.182209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:29.182481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:29.183197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:29.184832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:29.195063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1025/2044] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:29.199038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:29.209108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6133-6998-4a7a-9685-b912a63f4da4 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:29.215076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430b8a1-746c-423e-95b2-6c8a0c749813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:29.215740 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b8a1-746c-423e-95b2-6c8a0c749813 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:29.216037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b8a1-746c-423e-95b2-6c8a0c749813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:29.216313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b8a1-746c-423e-95b2-6c8a0c749813 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:29.217089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430b8a1-746c-423e-95b2-6c8a0c749813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:29.218716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430b8a1-746c-423e-95b2-6c8a0c749813 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:29.229203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1020/2045] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:29.233474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:29.243573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f26713-031e-4306-ae4f-a25ea865e3af admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:29.248999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:29.249894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:29.250174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:29.250450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] PATH_INFO: `/v3/projects/41c09128f4d0439b85ac6ebea838ea4f/users/a9dab2fcc08641eb9dadac6eb69c370a/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:29.265672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c09128f4d0439b85ac6ebea838ea4f, user_id=a9dab2fcc08641eb9dadac6eb69c370a, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:29.268329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:29.284014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1026/2046] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:29 2022] PUT /identity/v3/projects/41c09128f4d0439b85ac6ebea838ea4f/users/a9dab2fcc08641eb9dadac6eb69c370a/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:29.294675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01524e93-a451-42b1-b5b4-6708b8001aab None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:29.294966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01524e93-a451-42b1-b5b4-6708b8001aab None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:29.295249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01524e93-a451-42b1-b5b4-6708b8001aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:29.322437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-01524e93-a451-42b1-b5b4-6708b8001aab None None] MFA Rules not processed for user `a9dab2fcc08641eb9dadac6eb69c370a`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:29.323679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-01524e93-a451-42b1-b5b4-6708b8001aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:29.387805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1021/2047] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:29.399110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:29.401296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:29.478665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02c3e-b7f2-4912-8a30-f0dcefa8e1ca admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:29.484912 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2de0a-0164-4a57-8172-651af172b3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:29.485564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2de0a-0164-4a57-8172-651af172b3b5 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:29.485845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2de0a-0164-4a57-8172-651af172b3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:29.486121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2de0a-0164-4a57-8172-651af172b3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:29.494214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2de0a-0164-4a57-8172-651af172b3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:29.495803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2de0a-0164-4a57-8172-651af172b3b5 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:29.505266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1027/2048] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:33.242533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01524e93-a451-42b1-b5b4-6708b8001aab None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:33.314261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01524e93-a451-42b1-b5b4-6708b8001aab None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:33.320959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:33.322338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:33.322797 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:33.323240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] PATH_INFO: `/v3/users/a9dab2fcc08641eb9dadac6eb69c370a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:33.325373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9dab2fcc08641eb9dadac6eb69c370a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:33.328255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:33.379803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9dab2fcc08641eb9dadac6eb69c370a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.380429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9dab2fcc08641eb9dadac6eb69c370a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.388344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9dab2fcc08641eb9dadac6eb69c370a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.400811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9dab2fcc08641eb9dadac6eb69c370a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.407794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9dab2fcc08641eb9dadac6eb69c370a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.414105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1022/2049] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:33 2022] DELETE /identity/v3/users/a9dab2fcc08641eb9dadac6eb69c370a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:33.418853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:33.419347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:33.419436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:33.438571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:33.439916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:33.504939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1028/2050] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:33.515396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:33.517465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:33.578915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1973a41-143b-4807-a8e3-73958b30a2e6 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:33.583064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612241ad-508e-4a36-9353-44c92204ba18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:33.583728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612241ad-508e-4a36-9353-44c92204ba18 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:33.584135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612241ad-508e-4a36-9353-44c92204ba18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:33.584414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612241ad-508e-4a36-9353-44c92204ba18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:33.594061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612241ad-508e-4a36-9353-44c92204ba18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:33.595500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612241ad-508e-4a36-9353-44c92204ba18 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:33.605547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1023/2051] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:33.881547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:33.883230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:33.895216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9e590-04a8-4e55-9fa9-a7189945a118 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:33.899824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:33.900796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:33.901074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:33.901347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] PATH_INFO: `/v3/projects/41c09128f4d0439b85ac6ebea838ea4f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:33.902563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c09128f4d0439b85ac6ebea838ea4f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:33.904545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:33.953010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c09128f4d0439b85ac6ebea838ea4f', 'request_id': 'req-72967317-debe-44ec-a9c6-4746f3a55a1d'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.960613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c09128f4d0439b85ac6ebea838ea4f', 'request_id': 'req-72967317-debe-44ec-a9c6-4746f3a55a1d'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.967002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c09128f4d0439b85ac6ebea838ea4f', 'request_id': 'req-72967317-debe-44ec-a9c6-4746f3a55a1d'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.977400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] The token cache is being invalidate because project 41c09128f4d0439b85ac6ebea838ea4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:33.977662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.978379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-72967317-debe-44ec-a9c6-4746f3a55a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:33.979935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1029/2052] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:33 2022] DELETE /identity/v3/projects/41c09128f4d0439b85ac6ebea838ea4f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:33.985030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0821e-4346-4aef-9f34-aea37aee07ce None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:33.985324 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0821e-4346-4aef-9f34-aea37aee07ce None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:33.985608 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0821e-4346-4aef-9f34-aea37aee07ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.004058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-caa0821e-4346-4aef-9f34-aea37aee07ce None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:34.005313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-caa0821e-4346-4aef-9f34-aea37aee07ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:34.066470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1024/2053] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:34.075638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8628-ff01-4407-ae66-4df6fe7e01c2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.075928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8628-ff01-4407-ae66-4df6fe7e01c2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.076198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8628-ff01-4407-ae66-4df6fe7e01c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.096160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d95e8628-ff01-4407-ae66-4df6fe7e01c2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:34.097412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d95e8628-ff01-4407-ae66-4df6fe7e01c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:34.107387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1030/2054] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:34.112092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0821e-4346-4aef-9f34-aea37aee07ce None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.122264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0821e-4346-4aef-9f34-aea37aee07ce None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.127973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.128640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.128953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.129230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.129969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:34.130278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.131875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.143650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1025/2055] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:34.148121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8628-ff01-4407-ae66-4df6fe7e01c2 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.158158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8628-ff01-4407-ae66-4df6fe7e01c2 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.164741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.165371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.165634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.165964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.166988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.169041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.200266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1031/2056] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:34 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:34.204512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.214754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6523c8-bda6-4a4a-a9f4-1bb273709a1a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.277599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.278282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.278562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.278833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.279527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.281469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.301181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1026/2057] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:34 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:34.305404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.316238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309664e8-36f6-4c08-8218-e9fe894ce992 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.321313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.322075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.322356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.322657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.323388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.325040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.338010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1032/2058] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:34.342289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.353499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3787d-a590-4eb2-b378-1cd4861778c8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.359481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce907ccd-c03f-4d16-aec2-468b2ba54448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.360141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce907ccd-c03f-4d16-aec2-468b2ba54448 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.360427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce907ccd-c03f-4d16-aec2-468b2ba54448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.360715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce907ccd-c03f-4d16-aec2-468b2ba54448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.361449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce907ccd-c03f-4d16-aec2-468b2ba54448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.363057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce907ccd-c03f-4d16-aec2-468b2ba54448 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.374888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1027/2059] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:34.379587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.390651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad51b1-73b3-47c5-b412-ba5e63af9ce4 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.395667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.396603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.396785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.397070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] PATH_INFO: `/v3/projects/211467f5b74945b58718100c76e4cb35/users/e4a69e8e48064fd197ad45031daf7d13/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.412909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=211467f5b74945b58718100c76e4cb35, user_id=e4a69e8e48064fd197ad45031daf7d13, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.415791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.430247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1033/2060] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:34 2022] PUT /identity/v3/projects/211467f5b74945b58718100c76e4cb35/users/e4a69e8e48064fd197ad45031daf7d13/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:34.440703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f42b6-51e2-4a6d-b5df-53bc9e3cb1a4 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.441001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f42b6-51e2-4a6d-b5df-53bc9e3cb1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.441278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f42b6-51e2-4a6d-b5df-53bc9e3cb1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.471068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-347f42b6-51e2-4a6d-b5df-53bc9e3cb1a4 None None] MFA Rules not processed for user `e4a69e8e48064fd197ad45031daf7d13`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:34.472319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-347f42b6-51e2-4a6d-b5df-53bc9e3cb1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:34.536726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1028/2061] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:34.542032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.609216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b03e-ad3d-4cee-99e6-58fe70bfdc0f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.614037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.614700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.614983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.615257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.615960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.618002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.646751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1034/2062] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:34 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:34.651099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f42b6-51e2-4a6d-b5df-53bc9e3cb1a4 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.662037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f42b6-51e2-4a6d-b5df-53bc9e3cb1a4 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.719889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.720576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.720893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.721172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.721875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.723795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.746962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1029/2063] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:34 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:34.752951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.766257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5d817-4851-457a-9f7e-f784accfa817 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.772072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.772775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.773057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.773332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.774075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.775735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.786706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1035/2064] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:34.790908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.801643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4f18-157c-4d44-8300-0155c6bc9ffd admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.807924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.808843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.809125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.809405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] PATH_INFO: `/v3/projects/5fa49259158b4c7b973480d039251855/users/b7212f5603b64943bfaae779a98dd57c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.825586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa49259158b4c7b973480d039251855, user_id=b7212f5603b64943bfaae779a98dd57c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.828360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.842482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1030/2065] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:34 2022] PUT /identity/v3/projects/5fa49259158b4c7b973480d039251855/users/b7212f5603b64943bfaae779a98dd57c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:34.846505 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.858193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98c87c-a309-4e7e-902a-520d1c9b336f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.916845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecafc4d-1cca-41d8-8d7e-18226cb295b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.917525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecafc4d-1cca-41d8-8d7e-18226cb295b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.917804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecafc4d-1cca-41d8-8d7e-18226cb295b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.918077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecafc4d-1cca-41d8-8d7e-18226cb295b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.918811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecafc4d-1cca-41d8-8d7e-18226cb295b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.920401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecafc4d-1cca-41d8-8d7e-18226cb295b3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.935121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1036/2066] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:34.936624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:34.947428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348a257-88ad-4b66-8b57-204a2eefc68f admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:34.952719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:34.954629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.954629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.954629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] PATH_INFO: `/v3/projects/5fa49259158b4c7b973480d039251855/users/b7212f5603b64943bfaae779a98dd57c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:34.956354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa49259158b4c7b973480d039251855, user_id=b7212f5603b64943bfaae779a98dd57c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:34.959358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:34.970997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1031/2067] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:34 2022] PUT /identity/v3/projects/5fa49259158b4c7b973480d039251855/users/b7212f5603b64943bfaae779a98dd57c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:34.981251 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f675b8-2954-479b-bdae-e603c12190e5 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:34.981539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f675b8-2954-479b-bdae-e603c12190e5 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:34.981810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f675b8-2954-479b-bdae-e603c12190e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:35.007556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-99f675b8-2954-479b-bdae-e603c12190e5 None None] MFA Rules not processed for user `b7212f5603b64943bfaae779a98dd57c`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:35.008792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-99f675b8-2954-479b-bdae-e603c12190e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:35.076744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1037/2068] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:35.088212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:35.090144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:35.150517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918d3fd-28a7-46fa-82f7-7b7376b4ab63 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:35.154354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251eb56-d709-49dc-b178-e9af5e0c9f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:35.155012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251eb56-d709-49dc-b178-e9af5e0c9f0a service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:35.155297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251eb56-d709-49dc-b178-e9af5e0c9f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:35.155580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251eb56-d709-49dc-b178-e9af5e0c9f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:35.164814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251eb56-d709-49dc-b178-e9af5e0c9f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:35.166355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251eb56-d709-49dc-b178-e9af5e0c9f0a service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:35.175495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1032/2069] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:35.203340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f675b8-2954-479b-bdae-e603c12190e5 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:35.264769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f675b8-2954-479b-bdae-e603c12190e5 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:35.269558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:35.270432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:35.270713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:35.270987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] PATH_INFO: `/v3/users/e4a69e8e48064fd197ad45031daf7d13` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:35.272230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a69e8e48064fd197ad45031daf7d13)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:35.274221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:35.321674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a69e8e48064fd197ad45031daf7d13'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.322582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a69e8e48064fd197ad45031daf7d13'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.336399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a69e8e48064fd197ad45031daf7d13'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.346559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a69e8e48064fd197ad45031daf7d13'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.354067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a69e8e48064fd197ad45031daf7d13'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.363562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1038/2070] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:35 2022] DELETE /identity/v3/users/e4a69e8e48064fd197ad45031daf7d13 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:35.366440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:35.366964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:35.367391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:35.387996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:35.389255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:35.445997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1033/2071] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:35.456176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:35.457614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:35.516316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ab8a7-6d5e-4f73-9e05-71fba4848bf0 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:35.520185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:35.520867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:35.521148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:35.521417 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:35.530378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:35.531827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:35.541299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1039/2072] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:35.806404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:35.808029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:35.821238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7695c2-e6cc-4b14-b64a-fd60ba91b57b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:35.827919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:35.829067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:35.829249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:35.829518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] PATH_INFO: `/v3/projects/211467f5b74945b58718100c76e4cb35` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:35.830793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=211467f5b74945b58718100c76e4cb35)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:35.832777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:35.878640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211467f5b74945b58718100c76e4cb35', 'request_id': 'req-7068e1bc-058d-4db3-a846-b36955e118c3'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.887727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211467f5b74945b58718100c76e4cb35', 'request_id': 'req-7068e1bc-058d-4db3-a846-b36955e118c3'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.893887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211467f5b74945b58718100c76e4cb35', 'request_id': 'req-7068e1bc-058d-4db3-a846-b36955e118c3'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.904343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] The token cache is being invalidate because project 211467f5b74945b58718100c76e4cb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:35.904625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.905310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:35.906888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1034/2073] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:35 2022] DELETE /identity/v3/projects/211467f5b74945b58718100c76e4cb35 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:35.911314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:35.920984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2e51-4839-4d6e-865b-41d633963516 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:35.977418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:35.978495 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:35.978785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:35.979063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] PATH_INFO: `/v3/users/b7212f5603b64943bfaae779a98dd57c` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:35.980276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7212f5603b64943bfaae779a98dd57c)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:35.982242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.032586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7212f5603b64943bfaae779a98dd57c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.033301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7212f5603b64943bfaae779a98dd57c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.045299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7212f5603b64943bfaae779a98dd57c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.053937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7212f5603b64943bfaae779a98dd57c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.061134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7212f5603b64943bfaae779a98dd57c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.067304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1040/2074] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:35 2022] DELETE /identity/v3/users/b7212f5603b64943bfaae779a98dd57c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:36.338637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.340201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:36.353813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068e1bc-058d-4db3-a846-b36955e118c3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.426936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.427830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.428106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.428379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] PATH_INFO: `/v3/projects/5fa49259158b4c7b973480d039251855` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.429762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa49259158b4c7b973480d039251855)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.431800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.437727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.439322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:36.452995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b765004-e63a-420b-bef5-30bab3b9a776 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.459419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.460353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.460574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.460887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] PATH_INFO: `/v3/users/7afa6d07275d44a5b1ae627752b0d552` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.462109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afa6d07275d44a5b1ae627752b0d552)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.464183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.480098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa49259158b4c7b973480d039251855', 'request_id': 'req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.488874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa49259158b4c7b973480d039251855', 'request_id': 'req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.495299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa49259158b4c7b973480d039251855', 'request_id': 'req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.506217 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] The token cache is being invalidate because project 5fa49259158b4c7b973480d039251855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:36.506511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.507173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d47cb01d-0fcc-40bc-a6e4-78cf1ce5b97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.508834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1035/2075] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:36 2022] DELETE /identity/v3/projects/5fa49259158b4c7b973480d039251855 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:36.513577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c582d92-ffe8-48b7-88a5-8b5e2d8ec64c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.513871 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c582d92-ffe8-48b7-88a5-8b5e2d8ec64c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.514156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c582d92-ffe8-48b7-88a5-8b5e2d8ec64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.515434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afa6d07275d44a5b1ae627752b0d552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.516086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afa6d07275d44a5b1ae627752b0d552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.527660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afa6d07275d44a5b1ae627752b0d552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.532045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0c582d92-ffe8-48b7-88a5-8b5e2d8ec64c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:36.533623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0c582d92-ffe8-48b7-88a5-8b5e2d8ec64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:36.536117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afa6d07275d44a5b1ae627752b0d552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.542817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-27ea4d9a-c1c6-4003-a718-1356def2eb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afa6d07275d44a5b1ae627752b0d552'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:36.548632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1041/2076] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:36 2022] DELETE /identity/v3/users/7afa6d07275d44a5b1ae627752b0d552 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:36.553107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067617a0-127d-4837-a9db-31e985007554 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.553394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067617a0-127d-4837-a9db-31e985007554 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.553670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067617a0-127d-4837-a9db-31e985007554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.571373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-067617a0-127d-4837-a9db-31e985007554 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:36.572628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-067617a0-127d-4837-a9db-31e985007554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:36.592520 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1036/2077] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:36.601365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fed75-4008-413d-9f1e-7c854b8e8fcc None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.601653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fed75-4008-413d-9f1e-7c854b8e8fcc None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.601929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fed75-4008-413d-9f1e-7c854b8e8fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.619775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-bd6fed75-4008-413d-9f1e-7c854b8e8fcc None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:36.621030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-bd6fed75-4008-413d-9f1e-7c854b8e8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:36.629852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1042/2078] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:36.639498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067617a0-127d-4837-a9db-31e985007554 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.640835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-067617a0-127d-4837-a9db-31e985007554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:36.681187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1037/2079] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:36.685603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fed75-4008-413d-9f1e-7c854b8e8fcc None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.694146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fed75-4008-413d-9f1e-7c854b8e8fcc None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.696606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067617a0-127d-4837-a9db-31e985007554 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.698958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.699610 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.699891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.700165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.700932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:36.701051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.701240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.701599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.701883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.702159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.702828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.711734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.713227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.717266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1038/2080] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:59:36.718194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.723212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1043/2081] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:36.727886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480e343-b71d-4ebd-8056-205d073cfce7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.733082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.733739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.734024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.734296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.734993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.736901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.766128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1039/2082] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:36 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:36.767301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.776987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c605-327e-476b-8458-357df4ede34b service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.834161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.834851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.835140 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.835420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.836134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.838105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.860931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1044/2083] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:36 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:36.864939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.877360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481a638-985d-442d-9eff-cbd37dfa6607 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.884497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.885109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.885388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.885657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.886397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.888291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.898377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1040/2084] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:36.902465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.912625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b321d-f485-4d6e-b535-402dc48ea916 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.917584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.918260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.918541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.918844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.919576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.921240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.931822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1045/2085] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:36.936573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.946378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b78c2b-6972-43f9-b0ca-be72b568d047 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:36.951457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bb81f-d0f6-42b5-b38d-edd3a07f58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:36.952347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bb81f-d0f6-42b5-b38d-edd3a07f58b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.952630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bb81f-d0f6-42b5-b38d-edd3a07f58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.952998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bb81f-d0f6-42b5-b38d-edd3a07f58b2 admin admin] PATH_INFO: `/v3/projects/70fa34e4bbf5417b88193f304306f877/users/a4078bd227bd470080a6d618187ec492/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.968323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bb81f-d0f6-42b5-b38d-edd3a07f58b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fa34e4bbf5417b88193f304306f877, user_id=a4078bd227bd470080a6d618187ec492, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:36.971197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bb81f-d0f6-42b5-b38d-edd3a07f58b2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:36.983938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1041/2086] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:36 2022] PUT /identity/v3/projects/70fa34e4bbf5417b88193f304306f877/users/a4078bd227bd470080a6d618187ec492/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:36.993988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:36.995928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfde719-9035-4116-bf94-1995c6e9ae5a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:36.996217 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfde719-9035-4116-bf94-1995c6e9ae5a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:36.996522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfde719-9035-4116-bf94-1995c6e9ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:36.998163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:37.012075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66e5f-b8f8-4a2d-9f78-87bd5bfad4b8 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.035333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-bdfde719-9035-4116-bf94-1995c6e9ae5a None None] MFA Rules not processed for user `a4078bd227bd470080a6d618187ec492`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:37.036558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-bdfde719-9035-4116-bf94-1995c6e9ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:37.067286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.068167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.068453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.068755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] PATH_INFO: `/v3/projects/427cd0f319be456785a3dd74e76af977` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.069951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=427cd0f319be456785a3dd74e76af977)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.072293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.100743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1042/2087] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:37.103557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfde719-9035-4116-bf94-1995c6e9ae5a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.113890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfde719-9035-4116-bf94-1995c6e9ae5a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.121988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427cd0f319be456785a3dd74e76af977', 'request_id': 'req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:37.130026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427cd0f319be456785a3dd74e76af977', 'request_id': 'req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:37.136211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427cd0f319be456785a3dd74e76af977', 'request_id': 'req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:37.147314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] The token cache is being invalidate because project 427cd0f319be456785a3dd74e76af977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:37.147605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:37.148347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:37.150314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1046/2088] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:36 2022] DELETE /identity/v3/projects/427cd0f319be456785a3dd74e76af977 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:37.171370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.172065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.172374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.172659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.173409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.175349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.203842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1043/2089] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:37 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:37.208246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.209780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:37.225837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722865f-daf6-4a90-9bb0-d27ccb9d9b8c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.299616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.300591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.300905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.301189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.301910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.304351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.344122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1047/2090] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:37 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:37.351340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.362253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acf444-a9d7-4001-8de8-0454bf55a34b admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.367171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.367894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.368297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.368616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.369490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.371092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.382228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1044/2091] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:37.386745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.396572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714ce5-0164-4442-89b7-7e6736e64d0c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.401211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.402095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.402367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.402637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] PATH_INFO: `/v3/projects/779e88605a9143998fc47038df8b50e3/users/3eb3fa9acee047118293c888e13d7809/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.417111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779e88605a9143998fc47038df8b50e3, user_id=3eb3fa9acee047118293c888e13d7809, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.419795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.436048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1048/2092] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:37 2022] PUT /identity/v3/projects/779e88605a9143998fc47038df8b50e3/users/3eb3fa9acee047118293c888e13d7809/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:37.440205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.451971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504462e4-9baf-4254-af51-d91f5cd5b085 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.509386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129265-153e-453d-af03-fba333415120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.510053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129265-153e-453d-af03-fba333415120 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.510330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129265-153e-453d-af03-fba333415120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.510615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129265-153e-453d-af03-fba333415120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.511304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8129265-153e-453d-af03-fba333415120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.512944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8129265-153e-453d-af03-fba333415120 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.523468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1045/2093] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:37.527967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.539357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7494ec-6e6b-47bd-885e-e853ca28dcb6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.544921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.545824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.546110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.546387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] PATH_INFO: `/v3/projects/779e88605a9143998fc47038df8b50e3/users/3eb3fa9acee047118293c888e13d7809/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.548628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779e88605a9143998fc47038df8b50e3, user_id=3eb3fa9acee047118293c888e13d7809, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.551314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.562619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1049/2094] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:37 2022] PUT /identity/v3/projects/779e88605a9143998fc47038df8b50e3/users/3eb3fa9acee047118293c888e13d7809/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:37.574136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db302bdc-5580-4f56-b12a-ba766c97d59f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.574873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db302bdc-5580-4f56-b12a-ba766c97d59f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.575558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db302bdc-5580-4f56-b12a-ba766c97d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.604194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-db302bdc-5580-4f56-b12a-ba766c97d59f None None] MFA Rules not processed for user `3eb3fa9acee047118293c888e13d7809`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:37.605441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-db302bdc-5580-4f56-b12a-ba766c97d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:37.671890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1046/2095] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:37.684069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.686413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:37.751542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6548dfa-d252-40a7-9f9b-181c82bf3299 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.756202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.756896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.757208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.757486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.767883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.769369 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.779882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1050/2096] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:37.867080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db302bdc-5580-4f56-b12a-ba766c97d59f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:37.877575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db302bdc-5580-4f56-b12a-ba766c97d59f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:37.881398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd3b56-72b1-4937-81c6-2017866224b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:37.882050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3b56-72b1-4937-81c6-2017866224b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:37.882306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3b56-72b1-4937-81c6-2017866224b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:37.882584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3b56-72b1-4937-81c6-2017866224b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:37.884512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-15dd3b56-72b1-4937-81c6-2017866224b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:37.944546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd3b56-72b1-4937-81c6-2017866224b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:37.946034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd3b56-72b1-4937-81c6-2017866224b0 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:37.955280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1047/2097] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:42.725739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:42.791726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d1f3f-a0c3-4153-a3ab-5e7e20d89080 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:42.796903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:42.797819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:42.798108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:42.798382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] PATH_INFO: `/v3/users/a4078bd227bd470080a6d618187ec492` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:42.799741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4078bd227bd470080a6d618187ec492)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:42.801603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:42.850040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4078bd227bd470080a6d618187ec492'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:42.850683 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4078bd227bd470080a6d618187ec492'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:42.862303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4078bd227bd470080a6d618187ec492'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:42.872692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4078bd227bd470080a6d618187ec492'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:42.881765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4078bd227bd470080a6d618187ec492'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:42.888888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1051/2098] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:42 2022] DELETE /identity/v3/users/a4078bd227bd470080a6d618187ec492 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:42.893596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:42.894058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:42.894165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:42.911585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:42.912842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:42.933626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:42.935356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:42.973156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1048/2099] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:42.983006 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:42.984353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:43.001383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546432d-0fce-4b52-af63-eefb491454a2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.006080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.006944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.007220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.007509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] PATH_INFO: `/v3/users/36eeb6f3e9e348f7b439253a2d92fc8e` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.008696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36eeb6f3e9e348f7b439253a2d92fc8e)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.010715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.040604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1904ca-eb6c-4bb3-a278-55de7749a91e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.044475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e8995-6d4d-4ced-a603-5e4a7679d21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.045121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8995-6d4d-4ced-a603-5e4a7679d21c service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.045402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8995-6d4d-4ced-a603-5e4a7679d21c service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.045675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8995-6d4d-4ced-a603-5e4a7679d21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.054918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e8995-6d4d-4ced-a603-5e4a7679d21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.056529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e8995-6d4d-4ced-a603-5e4a7679d21c service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.058859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36eeb6f3e9e348f7b439253a2d92fc8e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.059546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36eeb6f3e9e348f7b439253a2d92fc8e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.066063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1049/2100] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:43.071287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36eeb6f3e9e348f7b439253a2d92fc8e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.079275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36eeb6f3e9e348f7b439253a2d92fc8e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.086689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36eeb6f3e9e348f7b439253a2d92fc8e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.093479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1052/2101] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:42 2022] DELETE /identity/v3/users/36eeb6f3e9e348f7b439253a2d92fc8e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:43.098084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.098377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.098655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.117078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:43.118351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:43.180134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1050/2102] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:43.190037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:43.191598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:43.248630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55fffb-a4c7-4130-8179-b3392200bd3a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.253407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.254066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.254355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.254629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.264851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.266303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.276537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1053/2103] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:43.366697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:43.368298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:43.384193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ce36-ebe1-45cc-9987-98e67481b0bf None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.390143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.391118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.391437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.391779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] PATH_INFO: `/v3/projects/70fa34e4bbf5417b88193f304306f877` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.393429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fa34e4bbf5417b88193f304306f877)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.395445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.446913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fa34e4bbf5417b88193f304306f877', 'request_id': 'req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.456111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fa34e4bbf5417b88193f304306f877', 'request_id': 'req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.462231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fa34e4bbf5417b88193f304306f877', 'request_id': 'req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.472971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] The token cache is being invalidate because project 70fa34e4bbf5417b88193f304306f877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:43.473266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.474542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.476350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1051/2104] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:43 2022] DELETE /identity/v3/projects/70fa34e4bbf5417b88193f304306f877 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:43.480159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:43.489986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dbbe6-e52a-4b4e-a960-37133d652ccb service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.558144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.558978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.559257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.559572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] PATH_INFO: `/v3/users/3eb3fa9acee047118293c888e13d7809` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.560761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb3fa9acee047118293c888e13d7809)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.562665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.603525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:43.605490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:43.613215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb3fa9acee047118293c888e13d7809'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.613878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb3fa9acee047118293c888e13d7809'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.621588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f70f2-8954-4ee2-b06f-eda788b1cef3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.626925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb3fa9acee047118293c888e13d7809'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.629514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.631012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.631349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.631691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] PATH_INFO: `/v3/projects/44d3ac788c374852b0a379711ce47b83` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.634271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d3ac788c374852b0a379711ce47b83)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.635661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.638291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb3fa9acee047118293c888e13d7809'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.645288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c39a9a6c-f289-4a06-b72e-8c7e97e7d5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb3fa9acee047118293c888e13d7809'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.655755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1054/2105] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:43 2022] DELETE /identity/v3/users/3eb3fa9acee047118293c888e13d7809 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:43.700529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d3ac788c374852b0a379711ce47b83', 'request_id': 'req-e01164fc-2be7-4123-a10b-0b72b260c331'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.710131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d3ac788c374852b0a379711ce47b83', 'request_id': 'req-e01164fc-2be7-4123-a10b-0b72b260c331'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.718100 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d3ac788c374852b0a379711ce47b83', 'request_id': 'req-e01164fc-2be7-4123-a10b-0b72b260c331'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.730943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] The token cache is being invalidate because project 44d3ac788c374852b0a379711ce47b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:43.731237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.732052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e01164fc-2be7-4123-a10b-0b72b260c331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:43.734078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1052/2106] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:43 2022] DELETE /identity/v3/projects/44d3ac788c374852b0a379711ce47b83 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:43.739840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c98899-41b8-4480-a618-5b2989754e87 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.741190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c98899-41b8-4480-a618-5b2989754e87 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.741492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c98899-41b8-4480-a618-5b2989754e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.763473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d5c98899-41b8-4480-a618-5b2989754e87 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:43.765166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d5c98899-41b8-4480-a618-5b2989754e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:43.825554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1055/2107] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:43.833518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e35311-0467-40f6-a9cd-548edd43cef0 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.833776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e35311-0467-40f6-a9cd-548edd43cef0 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.834098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e35311-0467-40f6-a9cd-548edd43cef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.854939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b6e35311-0467-40f6-a9cd-548edd43cef0 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:43.856220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b6e35311-0467-40f6-a9cd-548edd43cef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:43.865996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1053/2108] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:43.870674 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c98899-41b8-4480-a618-5b2989754e87 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:43.881702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c98899-41b8-4480-a618-5b2989754e87 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.887670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.888382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.888651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.888964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.889714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:43.890033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.891719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.905265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1056/2109] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:43.909696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e35311-0467-40f6-a9cd-548edd43cef0 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:43.919665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e35311-0467-40f6-a9cd-548edd43cef0 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:43.924890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:43.925570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:43.925857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:43.926136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:43.926849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:43.928786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:43.961508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1054/2110] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:43 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:43.962910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:43.973542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472222c8-f5bc-4fe4-b3a1-1742f4d56719 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.033868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.034562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.034845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.035118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.035872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.037846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.064981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1057/2111] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:43 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:44.066552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.077958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6619e-e713-43e9-a56d-ec19f63a13de admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.083290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.083971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.084377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.084658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.085430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.087068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.098012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1055/2112] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:44.102277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.112706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402973-05a7-4d1f-80de-8759925eec52 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.133883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b4bf7-4124-4603-a435-feec69c59c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.134604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b4bf7-4124-4603-a435-feec69c59c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.134879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b4bf7-4124-4603-a435-feec69c59c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.135159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b4bf7-4124-4603-a435-feec69c59c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.136165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b4bf7-4124-4603-a435-feec69c59c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.137849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b4bf7-4124-4603-a435-feec69c59c84 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.152963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1058/2113] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:44.155283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.172814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7e86b-105b-456b-a1ef-ec065ef249c8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.178003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.178910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.179194 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.179471 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] PATH_INFO: `/v3/projects/a8d8d0752c5c4cc6b88131941a19447e/users/c54378c1512a462595a4b48be883105a/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.195589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d8d0752c5c4cc6b88131941a19447e, user_id=c54378c1512a462595a4b48be883105a, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.199162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.215084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1056/2114] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:44 2022] PUT /identity/v3/projects/a8d8d0752c5c4cc6b88131941a19447e/users/c54378c1512a462595a4b48be883105a/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:44.225506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.225829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.226431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.257633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] MFA Rules not processed for user `c54378c1512a462595a4b48be883105a`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:44.259331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:44.268383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.270206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:44.343651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1059/2115] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:44.350181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cff1a-61d7-4290-a0fd-efe462fabfde admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.355012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.355767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.355940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.356278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.356523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] PATH_INFO: `/v3/projects/779e88605a9143998fc47038df8b50e3` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.357319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:44.357765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=779e88605a9143998fc47038df8b50e3)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.359704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.410241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779e88605a9143998fc47038df8b50e3', 'request_id': 'req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:44.415187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0545e9d-bca7-4248-ac3e-ae90a5991e05 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.419431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779e88605a9143998fc47038df8b50e3', 'request_id': 'req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:44.431456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779e88605a9143998fc47038df8b50e3', 'request_id': 'req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:44.438467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] The token cache is being invalidate because project 779e88605a9143998fc47038df8b50e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:44.438761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:44.439438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-afaafc97-8b1f-4b3a-a514-37a3273a2f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:44.441529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1057/2116] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:44 2022] DELETE /identity/v3/projects/779e88605a9143998fc47038df8b50e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:44.446656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c05f-9861-48f2-8baa-548f668437ac None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.446962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c05f-9861-48f2-8baa-548f668437ac None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.447308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c05f-9861-48f2-8baa-548f668437ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.471774 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ad31c05f-9861-48f2-8baa-548f668437ac None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:44.473232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ad31c05f-9861-48f2-8baa-548f668437ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:44.477206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.477954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.478237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.478509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.480362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:44.530902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1058/2117] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:44.539132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f92c-d064-4900-8f3f-45abda8813a8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.539551 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f92c-d064-4900-8f3f-45abda8813a8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.540001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f92c-d064-4900-8f3f-45abda8813a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.550836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.552314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.558453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3893f92c-d064-4900-8f3f-45abda8813a8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:44.559673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3893f92c-d064-4900-8f3f-45abda8813a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:44.561773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1060/2118] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:44.568133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1059/2119] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:44.573732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.585596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e05e-6bc0-4ad1-90b8-0f7ffadd4bd6 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.591475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.592227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.592629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.593027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.593907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:44.594181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.595957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.608719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1061/2120] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:44.612950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f92c-d064-4900-8f3f-45abda8813a8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.622379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f92c-d064-4900-8f3f-45abda8813a8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.627502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.628189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.628494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.628804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.629540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.631449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.665243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1060/2121] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:44 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:44.666400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.676841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77801e6b-2e6d-434d-b231-bb2e79713793 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.733827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.734508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.734785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.735062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.735751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.737715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.758478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1062/2122] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:44 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:44.762662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.774482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac79bc1-83ed-4176-8091-fc6d903b6eb5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.779164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.779805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.780087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.780361 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.781415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.783063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.796763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1061/2123] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:44.797801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.814457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77bcd2-e1a8-4637-9193-a0ab20292641 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.822438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e2fb6-6909-47bd-81c8-9aa59703942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.823170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2fb6-6909-47bd-81c8-9aa59703942a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.823435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2fb6-6909-47bd-81c8-9aa59703942a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.823873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2fb6-6909-47bd-81c8-9aa59703942a admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.824780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e2fb6-6909-47bd-81c8-9aa59703942a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.826520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e2fb6-6909-47bd-81c8-9aa59703942a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.841636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1063/2124] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:44.842679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:44.854763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1bb32-ad1e-4416-a8b2-8c3c1be1ffa7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:44.859917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:44.860952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.861355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.861731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] PATH_INFO: `/v3/projects/336add1a53844a48b23358097612a13d/users/0d4d50071bf147d69c4d4680271bb653/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.877671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336add1a53844a48b23358097612a13d, user_id=0d4d50071bf147d69c4d4680271bb653, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:44.880444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:44.894048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1062/2125] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:44 2022] PUT /identity/v3/projects/336add1a53844a48b23358097612a13d/users/0d4d50071bf147d69c4d4680271bb653/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:44.904387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091e7d-4ba0-448e-a1b6-f31688d4092f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:44.904699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091e7d-4ba0-448e-a1b6-f31688d4092f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:44.904984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091e7d-4ba0-448e-a1b6-f31688d4092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:44.932283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b2091e7d-4ba0-448e-a1b6-f31688d4092f None None] MFA Rules not processed for user `0d4d50071bf147d69c4d4680271bb653`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:44.933824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b2091e7d-4ba0-448e-a1b6-f31688d4092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:45.002342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1064/2126] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:45.007148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.073072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5441-006d-4599-a30c-a21254a92a30 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.078313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.078967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.079260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.079526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.080231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.082158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.109881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1063/2127] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:45 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:45.114156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091e7d-4ba0-448e-a1b6-f31688d4092f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.124594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091e7d-4ba0-448e-a1b6-f31688d4092f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.180036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.180919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.181209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.181502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.182238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.184152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.206585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1065/2128] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:45 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:45.212234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.222637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180e00f-e3aa-4854-9ed3-00ce8c8575a7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.227772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.228442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.228752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.229029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.229795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.231487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.243860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1064/2129] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:45.247897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.258791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b2ef-5473-47d2-9616-cf286a0927bf admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.264436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b364dda-1a4d-4352-b445-6eecc1bb9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.265145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b364dda-1a4d-4352-b445-6eecc1bb9815 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.265430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b364dda-1a4d-4352-b445-6eecc1bb9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.265710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b364dda-1a4d-4352-b445-6eecc1bb9815 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.266457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b364dda-1a4d-4352-b445-6eecc1bb9815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.268059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b364dda-1a4d-4352-b445-6eecc1bb9815 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.280897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1066/2130] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:45.285162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.295302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd29e-e7de-4930-8b96-92ed42bc5147 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.301684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.302919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.303383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.303665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] PATH_INFO: `/v3/projects/1907018e13844fb493e0380ea1d87357/users/3c99f624a18242fbbf494149d8d41437/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.321660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1907018e13844fb493e0380ea1d87357, user_id=3c99f624a18242fbbf494149d8d41437, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.324846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.339606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1065/2131] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:45 2022] PUT /identity/v3/projects/1907018e13844fb493e0380ea1d87357/users/3c99f624a18242fbbf494149d8d41437/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:45.350586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399abd36-753c-4d6b-8434-e3dcf9c4c85f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.350848 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399abd36-753c-4d6b-8434-e3dcf9c4c85f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.351125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399abd36-753c-4d6b-8434-e3dcf9c4c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.378546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-399abd36-753c-4d6b-8434-e3dcf9c4c85f None None] MFA Rules not processed for user `3c99f624a18242fbbf494149d8d41437`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:45.380073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-399abd36-753c-4d6b-8434-e3dcf9c4c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:45.446545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1067/2132] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:45.451398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.521543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7062a-cbc4-4bb6-aa6d-0598d9cb9373 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.526558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.527247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.527528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.527814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.528512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.530483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.568690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1066/2133] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:45 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:45.573796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399abd36-753c-4d6b-8434-e3dcf9c4c85f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.585228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399abd36-753c-4d6b-8434-e3dcf9c4c85f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.647071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.647664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.647948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.648230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.648954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.650907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.673566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1068/2134] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:45 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:59:45.677551 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.688282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3f1a-65c6-40d3-a8c0-d6b150ba5b36 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.694107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.694777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.695062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.695336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.696080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.697808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.708514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1067/2135] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:59:45.712849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.723579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1334e1-3c7e-4957-8826-320dea68d2ba admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.729711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.730591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.730863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.731136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] PATH_INFO: `/v3/projects/caac3eee7bcc4321803d2b8303076c78/users/b1efa62d6c9345b3960125a96ed81524/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.746669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caac3eee7bcc4321803d2b8303076c78, user_id=b1efa62d6c9345b3960125a96ed81524, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.749353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.766292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1069/2136] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:45 2022] PUT /identity/v3/projects/caac3eee7bcc4321803d2b8303076c78/users/b1efa62d6c9345b3960125a96ed81524/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:45.770468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.781167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0a41-63e6-4dd9-a534-07ffabe3cdc7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.844046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13fc8e-17d5-4ca5-88af-5afaceb9e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.844891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fc8e-17d5-4ca5-88af-5afaceb9e41a admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.845170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fc8e-17d5-4ca5-88af-5afaceb9e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.845438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fc8e-17d5-4ca5-88af-5afaceb9e41a admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.846563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13fc8e-17d5-4ca5-88af-5afaceb9e41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.849048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13fc8e-17d5-4ca5-88af-5afaceb9e41a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.860721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1068/2137] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:45.864943 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:45.876407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0d06-15a0-46db-ab6c-e0d150f5dde1 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:45.881970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:45.882873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.883156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.883440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] PATH_INFO: `/v3/projects/caac3eee7bcc4321803d2b8303076c78/users/b1efa62d6c9345b3960125a96ed81524/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.886344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caac3eee7bcc4321803d2b8303076c78, user_id=b1efa62d6c9345b3960125a96ed81524, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:45.890918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:45.905237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1070/2138] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:45 2022] PUT /identity/v3/projects/caac3eee7bcc4321803d2b8303076c78/users/b1efa62d6c9345b3960125a96ed81524/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:45.916508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5525-f29c-4a0b-bd2d-89317cd0532b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:45.916825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5525-f29c-4a0b-bd2d-89317cd0532b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:45.917106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5525-f29c-4a0b-bd2d-89317cd0532b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:45.944395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-fd6c5525-f29c-4a0b-bd2d-89317cd0532b None None] MFA Rules not processed for user `b1efa62d6c9345b3960125a96ed81524`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:45.945628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fd6c5525-f29c-4a0b-bd2d-89317cd0532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:46.020519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1069/2139] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:46.032812 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:46.034568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:46.101999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e805970-4bff-4995-b880-8dbd01fd6849 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:46.105693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:46.106339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:46.106618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:46.106891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:46.168550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:46.171798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:46.181423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1071/2140] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:49.821921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c5525-f29c-4a0b-bd2d-89317cd0532b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:49.832403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c5525-f29c-4a0b-bd2d-89317cd0532b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:49.836632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:49.837317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:49.837639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:49.837917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:49.895867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:49.897413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:49.907000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1070/2141] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:50.478392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:50.480094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:50.491275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367325e8-0ced-4d70-b370-b07d443f2f73 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:50.495249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad415fa-2417-4ac6-821a-08c416d27df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:50.496024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad415fa-2417-4ac6-821a-08c416d27df5 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:50.496301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad415fa-2417-4ac6-821a-08c416d27df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:50.496574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad415fa-2417-4ac6-821a-08c416d27df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:50.506344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad415fa-2417-4ac6-821a-08c416d27df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:50.507844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad415fa-2417-4ac6-821a-08c416d27df5 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:50.517877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1072/2142] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:59:57.563666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:57.631821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2967b-c71e-4134-8d3c-1fd5ddc87dcc service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:57.636942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:57.638047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:57.638327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:57.638637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] PATH_INFO: `/v3/users/0d4d50071bf147d69c4d4680271bb653` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:57.639925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4d50071bf147d69c4d4680271bb653)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:57.641877 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:57.694085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4d50071bf147d69c4d4680271bb653'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:57.694743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4d50071bf147d69c4d4680271bb653'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:57.702918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4d50071bf147d69c4d4680271bb653'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:57.717101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4d50071bf147d69c4d4680271bb653'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:57.724441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4d50071bf147d69c4d4680271bb653'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:57.731690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1071/2143] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:57 2022] DELETE /identity/v3/users/0d4d50071bf147d69c4d4680271bb653 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:57.736657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:57.737445 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:57.737836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:57.756988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:57.758331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:57.820788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1073/2144] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:57.830786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:57.832220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:57.887814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38453257-d9e7-463e-bafe-8af428e19218 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:57.891583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:57.892262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:57.892583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:57.892889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:57.902128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:57.903566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:57.913997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1072/2145] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 18:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:59:58.184949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:58.186589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:58.208637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d00d1-e915-4248-91d0-5c377dbebece None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:58.216056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:58.217667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:58.218228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:58.218789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] PATH_INFO: `/v3/projects/336add1a53844a48b23358097612a13d` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:58.220871 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336add1a53844a48b23358097612a13d)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:58.223771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:58.279116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336add1a53844a48b23358097612a13d', 'request_id': 'req-18d46562-a890-4182-96a5-b8a6f0d46f26'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.289734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336add1a53844a48b23358097612a13d', 'request_id': 'req-18d46562-a890-4182-96a5-b8a6f0d46f26'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.299464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336add1a53844a48b23358097612a13d', 'request_id': 'req-18d46562-a890-4182-96a5-b8a6f0d46f26'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.313171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] The token cache is being invalidate because project 336add1a53844a48b23358097612a13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:58.313796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.314833 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.317377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1074/2146] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:58 2022] DELETE /identity/v3/projects/336add1a53844a48b23358097612a13d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:58.325201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:58.332573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113d5df-ad8f-44d7-b5ea-c7ff571a5d9e service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:58.389299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:58.390229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:58.390479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:58.390752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] PATH_INFO: `/v3/users/3c99f624a18242fbbf494149d8d41437` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:58.391929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c99f624a18242fbbf494149d8d41437)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:58.393847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:58.441314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c99f624a18242fbbf494149d8d41437'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.441953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c99f624a18242fbbf494149d8d41437'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.451988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c99f624a18242fbbf494149d8d41437'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.464433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c99f624a18242fbbf494149d8d41437'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.471996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c99f624a18242fbbf494149d8d41437'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.478040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1073/2147] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:58 2022] DELETE /identity/v3/users/3c99f624a18242fbbf494149d8d41437 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:59:58.761705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:58.763151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:58.778077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46562-a890-4182-96a5-b8a6f0d46f26 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:58.836992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:58.837875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:58.838159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:58.838438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] PATH_INFO: `/v3/projects/1907018e13844fb493e0380ea1d87357` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:58.839705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1907018e13844fb493e0380ea1d87357)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:58.841788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:58.889116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1907018e13844fb493e0380ea1d87357', 'request_id': 'req-f1f7e423-bb11-41db-8782-e6f56b6363ad'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.898511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1907018e13844fb493e0380ea1d87357', 'request_id': 'req-f1f7e423-bb11-41db-8782-e6f56b6363ad'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.907324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1907018e13844fb493e0380ea1d87357', 'request_id': 'req-f1f7e423-bb11-41db-8782-e6f56b6363ad'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.921388 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] The token cache is being invalidate because project 1907018e13844fb493e0380ea1d87357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:58.921672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.922317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:58.923963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1075/2148] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:58 2022] DELETE /identity/v3/projects/1907018e13844fb493e0380ea1d87357 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:58.927973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:58.929514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:58.943936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc6b92-72a1-4e81-a16e-5bfafe086258 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.001693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.002573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.002860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.003133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] PATH_INFO: `/v3/users/b1efa62d6c9345b3960125a96ed81524` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.004377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1efa62d6c9345b3960125a96ed81524)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.006333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.055404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1efa62d6c9345b3960125a96ed81524'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.056062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1efa62d6c9345b3960125a96ed81524'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.064292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1efa62d6c9345b3960125a96ed81524'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.076151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1efa62d6c9345b3960125a96ed81524'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.082767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4209e3ad-d1ee-4a5d-82a7-5bca7d7c364e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1efa62d6c9345b3960125a96ed81524'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.088534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1074/2149] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 18:59:58 2022] DELETE /identity/v3/users/b1efa62d6c9345b3960125a96ed81524 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:59.367675 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:59.370506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:59.385740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e423-bb11-41db-8782-e6f56b6363ad admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.449551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.450355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.450639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.450917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] PATH_INFO: `/v3/projects/caac3eee7bcc4321803d2b8303076c78` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.452292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=caac3eee7bcc4321803d2b8303076c78)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.454348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.502214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caac3eee7bcc4321803d2b8303076c78', 'request_id': 'req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.511637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caac3eee7bcc4321803d2b8303076c78', 'request_id': 'req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.518106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caac3eee7bcc4321803d2b8303076c78', 'request_id': 'req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.528052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] The token cache is being invalidate because project caac3eee7bcc4321803d2b8303076c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:59:59.528338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.529065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7cc67a1f-da7d-4cf9-8f8b-4d7ed8154f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:59:59.531462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1076/2150] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 18:59:59 2022] DELETE /identity/v3/projects/caac3eee7bcc4321803d2b8303076c78 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:59.537128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3bfae-8501-4dd6-8f74-eca76ed2676d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.537418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3bfae-8501-4dd6-8f74-eca76ed2676d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.537682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3bfae-8501-4dd6-8f74-eca76ed2676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.556292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e0c3bfae-8501-4dd6-8f74-eca76ed2676d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:59.557508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e0c3bfae-8501-4dd6-8f74-eca76ed2676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:59.617126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1075/2151] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:59:59.627451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddcd9b-89e8-4fa7-a8ee-284000a36f67 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.627759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddcd9b-89e8-4fa7-a8ee-284000a36f67 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.628048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddcd9b-89e8-4fa7-a8ee-284000a36f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.647791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c0ddcd9b-89e8-4fa7-a8ee-284000a36f67 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:59:59.649040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c0ddcd9b-89e8-4fa7-a8ee-284000a36f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:59:59.658276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1077/2152] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:59:59.662571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3bfae-8501-4dd6-8f74-eca76ed2676d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:59.673984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3bfae-8501-4dd6-8f74-eca76ed2676d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.681489 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.682416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.682724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.683022 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.683942 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:59:59.684302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.686787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.702587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1076/2153] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 18:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:59:59.706777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddcd9b-89e8-4fa7-a8ee-284000a36f67 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:59.717723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddcd9b-89e8-4fa7-a8ee-284000a36f67 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.723093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.723751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.724038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.724446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.725173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.727090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.755862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1078/2154] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 18:59:59 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:59.760246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:59.770385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d17b-d861-45b0-9ce6-b08ddfb2a536 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.827264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.827946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.828210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.828475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.829201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.831144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.853215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1077/2155] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 18:59:59 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:59:59.857360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:59.868149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d8fa-708a-4d1c-a7d6-cc96a337bb55 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.873031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.873726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.874008 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.874281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.875325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.876971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.887966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1079/2156] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:59.892364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:59.902949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e9cf-e7fc-4d59-b643-16ca7554d36f admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.908598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163cc9-3c71-4be0-b9b3-b1a293f90c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.909291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163cc9-3c71-4be0-b9b3-b1a293f90c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.909574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163cc9-3c71-4be0-b9b3-b1a293f90c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.909848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163cc9-3c71-4be0-b9b3-b1a293f90c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.910590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163cc9-3c71-4be0-b9b3-b1a293f90c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.912203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163cc9-3c71-4be0-b9b3-b1a293f90c67 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.922480 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1078/2157] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 18:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:59:59.926691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:59:59.937629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae44389-20f0-47e6-8ed8-928965cd55e3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:59:59.943096 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:59:59.944005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.944283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.944558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] PATH_INFO: `/v3/projects/6dc3dce6010e45e29364df5b439507e0/users/7e560ca2695844fd8b7d7ac134f8a4b5/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:59:59.959716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc3dce6010e45e29364df5b439507e0, user_id=7e560ca2695844fd8b7d7ac134f8a4b5, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:59:59.962348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:59:59.976898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1080/2158] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 18:59:59 2022] PUT /identity/v3/projects/6dc3dce6010e45e29364df5b439507e0/users/7e560ca2695844fd8b7d7ac134f8a4b5/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:59:59.988128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:59:59.988663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:59:59.988663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:00.015663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] MFA Rules not processed for user `7e560ca2695844fd8b7d7ac134f8a4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:00.016960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:00.079077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1079/2159] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:00.094597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:00.096580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:00.153158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ddd2-4773-4c8d-abd1-52bb06517957 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:00.157655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1fea8-2459-4991-8250-72d4959a66c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:00.158296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fea8-2459-4991-8250-72d4959a66c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:00.158577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fea8-2459-4991-8250-72d4959a66c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:00.158857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fea8-2459-4991-8250-72d4959a66c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:00.167735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1fea8-2459-4991-8250-72d4959a66c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:00.169250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1fea8-2459-4991-8250-72d4959a66c0 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:00.178433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1081/2160] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:06.345270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:06.346987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:06.503054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488aaa81-a46d-4908-b6db-945d352cf894 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:06.512178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:06.513519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:06.513801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:06.514075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] PATH_INFO: `/v3/users/c54378c1512a462595a4b48be883105a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:06.515307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54378c1512a462595a4b48be883105a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:06.517588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:06.584853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54378c1512a462595a4b48be883105a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:06.585923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54378c1512a462595a4b48be883105a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:06.600506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54378c1512a462595a4b48be883105a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:06.617015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54378c1512a462595a4b48be883105a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:06.626818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54378c1512a462595a4b48be883105a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:06.634812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1080/2161] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:00:06 2022] DELETE /identity/v3/users/c54378c1512a462595a4b48be883105a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:06.640541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a18cb-2869-4e71-882e-ac06cf49c1e8 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:06.641039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a18cb-2869-4e71-882e-ac06cf49c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:06.641420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a18cb-2869-4e71-882e-ac06cf49c1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:06.680610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b29a18cb-2869-4e71-882e-ac06cf49c1e8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:06.683084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b29a18cb-2869-4e71-882e-ac06cf49c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:06.767452 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1082/2162] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:06.778540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:06.780442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:06.812738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:06.813053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:06.813425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:06.834860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] MFA Rules not processed for user `68b1c1f3865042b1bb208cc36b612c55`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:06.836158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:06.900515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277e67b-bfc7-4a7e-a7cf-1f6ea016c2f3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:06.906628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc0cd2-09d3-42aa-a728-f930b0650dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:06.907287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0cd2-09d3-42aa-a728-f930b0650dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:06.907571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0cd2-09d3-42aa-a728-f930b0650dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:06.907847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0cd2-09d3-42aa-a728-f930b0650dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:06.915345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1083/2163] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:06.928305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc0cd2-09d3-42aa-a728-f930b0650dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:06.930144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc0cd2-09d3-42aa-a728-f930b0650dc1 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:06.944386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1081/2164] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:07.471254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:07.472804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:07.487708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8eba-6033-409b-8a86-2a0eca12bd62 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:07.493577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:07.494618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:07.494909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:07.495305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] PATH_INFO: `/v3/projects/a8d8d0752c5c4cc6b88131941a19447e` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:07.496519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d8d0752c5c4cc6b88131941a19447e)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:07.498646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:07.549994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d8d0752c5c4cc6b88131941a19447e', 'request_id': 'req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:07.557171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d8d0752c5c4cc6b88131941a19447e', 'request_id': 'req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:07.563913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d8d0752c5c4cc6b88131941a19447e', 'request_id': 'req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:07.574531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] The token cache is being invalidate because project a8d8d0752c5c4cc6b88131941a19447e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:00:07.574894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:07.575634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-8ecdb8ae-c5ac-448c-81e6-46bafac8bebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:07.577634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1084/2165] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:00:07 2022] DELETE /identity/v3/projects/a8d8d0752c5c4cc6b88131941a19447e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:07.582493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d92062-40b8-4311-9da2-657e6ba20911 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:07.582962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d92062-40b8-4311-9da2-657e6ba20911 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:07.583053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d92062-40b8-4311-9da2-657e6ba20911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:07.630632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-77d92062-40b8-4311-9da2-657e6ba20911 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:07.632148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-77d92062-40b8-4311-9da2-657e6ba20911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:07.695807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1082/2166] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:00:07.704517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ce0dc-c2b3-41cb-b77d-8e792206d646 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:07.705007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ce0dc-c2b3-41cb-b77d-8e792206d646 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:07.705086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ce0dc-c2b3-41cb-b77d-8e792206d646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:07.724084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-221ce0dc-c2b3-41cb-b77d-8e792206d646 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:07.725237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-221ce0dc-c2b3-41cb-b77d-8e792206d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:07.733942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1085/2167] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:07.738134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d92062-40b8-4311-9da2-657e6ba20911 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:07.749201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d92062-40b8-4311-9da2-657e6ba20911 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:07.754469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:07.755137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:07.755421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:07.755695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:07.756586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:00:07.757071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:07.758855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:07.776492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1083/2168] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:00:07.777925 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ce0dc-c2b3-41cb-b77d-8e792206d646 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:07.787339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ce0dc-c2b3-41cb-b77d-8e792206d646 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:07.793485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:07.794844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:07.795364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:07.796228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:07.796630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:07.799348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:07.839454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:07.846025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1086/2169] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:00:07 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:00:07.849848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fa79a-dea9-4fc9-98ad-f0c44e3d12c8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:07.917866 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:07.918558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:07.918845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:07.919590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:07.919993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:07.921823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:07.946862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1084/2170] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:00:07 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:00:07.950675 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:07.963038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb91e4-018f-412d-836a-43b0ab7e7e91 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:07.971961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:07.972988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:07.973498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:07.973990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:07.974885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:07.977085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:07.995041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1087/2171] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:07.998473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.010306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d9ffb-1111-42ba-8cb0-98ddf6fc2a17 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.015689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5a6e2-8b87-4793-b163-5a546af37f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.016590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a6e2-8b87-4793-b163-5a546af37f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.016996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a6e2-8b87-4793-b163-5a546af37f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.017271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a6e2-8b87-4793-b163-5a546af37f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.018005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5a6e2-8b87-4793-b163-5a546af37f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.019599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5a6e2-8b87-4793-b163-5a546af37f18 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.036242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1085/2172] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:08.037796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.048163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a36e62-4bbc-454b-bfed-e539a8ecc416 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.053215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.054922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.055437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.055732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] PATH_INFO: `/v3/projects/070bda4e77eb4ed9b1f828d2a8bb4235/users/5d6088484ee04363b96ef98d872d7e79/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.074389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=070bda4e77eb4ed9b1f828d2a8bb4235, user_id=5d6088484ee04363b96ef98d872d7e79, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.076256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.097327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1088/2173] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:00:08 2022] PUT /identity/v3/projects/070bda4e77eb4ed9b1f828d2a8bb4235/users/5d6088484ee04363b96ef98d872d7e79/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:08.102301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4f73d-5c33-4186-a875-d94e4c6bb71e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.102590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4f73d-5c33-4186-a875-d94e4c6bb71e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.102869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4f73d-5c33-4186-a875-d94e4c6bb71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.135182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-38c4f73d-5c33-4186-a875-d94e4c6bb71e None None] MFA Rules not processed for user `5d6088484ee04363b96ef98d872d7e79`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:08.136431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-38c4f73d-5c33-4186-a875-d94e4c6bb71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:08.273559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1086/2174] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:08.278482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.366586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d823d-2172-44c8-9e23-ef9f6ea965ca admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.371549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.372221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.372566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.372878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.373594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.377377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.408014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1089/2175] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:00:08 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:00:08.409286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4f73d-5c33-4186-a875-d94e4c6bb71e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.420385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4f73d-5c33-4186-a875-d94e4c6bb71e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.483341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.483920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.484202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.484479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.485216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.487147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.511896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1087/2176] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:00:08 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:00:08.514599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.533077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20570d-546c-4545-82c1-a6b3b2e940bd admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.540557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.541435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.541719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.542088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.542952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.545187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.559141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1090/2177] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:08.563515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.574754 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a850cb-b9a8-420c-9751-c21f1939ae39 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.580332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44490fbf-6104-4e68-b266-61d0a2cd8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.580999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490fbf-6104-4e68-b266-61d0a2cd8161 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.581337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490fbf-6104-4e68-b266-61d0a2cd8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.581625 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490fbf-6104-4e68-b266-61d0a2cd8161 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.582464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490fbf-6104-4e68-b266-61d0a2cd8161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.584247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490fbf-6104-4e68-b266-61d0a2cd8161 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.595189 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1088/2178] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:08.599558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.609836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6903586-841d-4733-aec7-7e8d8482eea1 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.614605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.615489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.615748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.616057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] PATH_INFO: `/v3/projects/67d612ea1b5649b1b8d4af1ca0bc9e37/users/04d5cd9b90aa4c9c90c0a1f153749c39/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.631172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d612ea1b5649b1b8d4af1ca0bc9e37, user_id=04d5cd9b90aa4c9c90c0a1f153749c39, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.633857 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.649127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1091/2179] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:00:08 2022] PUT /identity/v3/projects/67d612ea1b5649b1b8d4af1ca0bc9e37/users/04d5cd9b90aa4c9c90c0a1f153749c39/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:08.659315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798dba8-06e8-480a-bccf-6143909e85ac None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.659606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798dba8-06e8-480a-bccf-6143909e85ac None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.659882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798dba8-06e8-480a-bccf-6143909e85ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.686109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4798dba8-06e8-480a-bccf-6143909e85ac None None] MFA Rules not processed for user `04d5cd9b90aa4c9c90c0a1f153749c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:08.687300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4798dba8-06e8-480a-bccf-6143909e85ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:08.752567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1089/2180] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:08.757383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.817581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a930f-9b8b-47ed-a153-fa21784f20e7 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.822351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.823002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.823283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.823556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.824240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.826317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.852277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1092/2181] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:00:08 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:00:08.856468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798dba8-06e8-480a-bccf-6143909e85ac None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.868017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798dba8-06e8-480a-bccf-6143909e85ac None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.927983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.928689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.928985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.929286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.930121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.932041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.955486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1090/2182] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:00:08 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:00:08.956720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:08.967042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ad33-8031-4079-b01f-5ef638af554e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:08.971831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:08.972478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:08.972803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:08.973057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:08.973784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:08.975374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:08.986819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1093/2183] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:08.991215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:09.001392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345c387-595e-46c1-8464-0ef8a0c7d678 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:09.006190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:09.007010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:09.007303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:09.007562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] PATH_INFO: `/v3/projects/2651bac231204e9faab32849b2cba9d9/users/2d56c743f527461383e93e7292e22542/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:09.025108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2651bac231204e9faab32849b2cba9d9, user_id=2d56c743f527461383e93e7292e22542, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:09.027760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:09.041462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1091/2184] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:00:08 2022] PUT /identity/v3/projects/2651bac231204e9faab32849b2cba9d9/users/2d56c743f527461383e93e7292e22542/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:09.045655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:09.055540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21634cfa-e98b-4953-b28a-b84ee3cdfffc admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:09.110566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02c228-8aed-4864-b3b7-762711df4811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:09.111515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c228-8aed-4864-b3b7-762711df4811 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:09.111515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c228-8aed-4864-b3b7-762711df4811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:09.111785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c228-8aed-4864-b3b7-762711df4811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:09.112518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02c228-8aed-4864-b3b7-762711df4811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:09.114202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02c228-8aed-4864-b3b7-762711df4811 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:09.123994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1094/2185] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:09.128913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:09.139461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb522a-08b1-4a64-8ce2-832c99104117 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:09.145152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:09.146053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:09.146333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:09.146605 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] PATH_INFO: `/v3/projects/2651bac231204e9faab32849b2cba9d9/users/2d56c743f527461383e93e7292e22542/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:09.148594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2651bac231204e9faab32849b2cba9d9, user_id=2d56c743f527461383e93e7292e22542, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:09.151268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:09.161490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1092/2186] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:00:09 2022] PUT /identity/v3/projects/2651bac231204e9faab32849b2cba9d9/users/2d56c743f527461383e93e7292e22542/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:09.172888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792f17-40ba-4cef-81cd-45d08095a87d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:09.173178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792f17-40ba-4cef-81cd-45d08095a87d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:09.173487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792f17-40ba-4cef-81cd-45d08095a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:09.202003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-34792f17-40ba-4cef-81cd-45d08095a87d None None] MFA Rules not processed for user `2d56c743f527461383e93e7292e22542`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:09.203238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-34792f17-40ba-4cef-81cd-45d08095a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:09.279292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1095/2187] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:09.290469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:09.292364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:09.366321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be79e35-434e-4d8c-9fb7-63f537785fab admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:09.373986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:09.374645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:09.375240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:09.375512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:09.437563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:09.438991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:09.447823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1093/2188] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:13.122838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34792f17-40ba-4cef-81cd-45d08095a87d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:13.134020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34792f17-40ba-4cef-81cd-45d08095a87d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:13.137862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:13.138542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:13.138970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:13.139254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:13.198021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:13.199577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:13.209385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1096/2189] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:13.815973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:13.824326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263494e-c562-4bb5-87c4-0f42194d64fa service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:13.827928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9e4d2-0762-4daa-9eab-08f74fe61660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:13.828567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e4d2-0762-4daa-9eab-08f74fe61660 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:13.828882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e4d2-0762-4daa-9eab-08f74fe61660 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:13.829160 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e4d2-0762-4daa-9eab-08f74fe61660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:13.838466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9e4d2-0762-4daa-9eab-08f74fe61660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:13.839935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9e4d2-0762-4daa-9eab-08f74fe61660 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:13.849822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1094/2190] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:18.083992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:18.157771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362d79-d112-4e26-8754-a8e8a3a6a9b8 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:18.162340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:18.163221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:18.163506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:18.163780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] PATH_INFO: `/v3/users/5d6088484ee04363b96ef98d872d7e79` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:18.165007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6088484ee04363b96ef98d872d7e79)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:18.166920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:18.214156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6088484ee04363b96ef98d872d7e79'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.214820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6088484ee04363b96ef98d872d7e79'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.227466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6088484ee04363b96ef98d872d7e79'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.235233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6088484ee04363b96ef98d872d7e79'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.242644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6088484ee04363b96ef98d872d7e79'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.250432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1097/2191] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:00:18 2022] DELETE /identity/v3/users/5d6088484ee04363b96ef98d872d7e79 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:18.255452 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a59b-14aa-43b7-a749-96e2d71a76e4 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:18.256096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a59b-14aa-43b7-a749-96e2d71a76e4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:18.256096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a59b-14aa-43b7-a749-96e2d71a76e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:18.274630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-f978a59b-14aa-43b7-a749-96e2d71a76e4 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:18.275856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f978a59b-14aa-43b7-a749-96e2d71a76e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:18.333080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1095/2192] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:18.343093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:18.344790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:18.402746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42b65-4d39-4259-b781-17a159b505d8 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:18.407554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:18.408207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:18.408486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:18.408814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:18.418560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:18.420185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:18.436386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1098/2193] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:00:18.484130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b3e50-6aba-4344-93eb-54a6cbc762de None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:18.484582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b3e50-6aba-4344-93eb-54a6cbc762de None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:18.485031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b3e50-6aba-4344-93eb-54a6cbc762de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:18.504178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-592b3e50-6aba-4344-93eb-54a6cbc762de None None] MFA Rules not processed for user `9d4785218d704599b5e3481ca05a4b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:18.505525 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-592b3e50-6aba-4344-93eb-54a6cbc762de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:18.565668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1096/2194] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:18.730354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:18.731795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:18.745384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453b00-cea6-4277-b708-ada0920130de service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:18.751956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:18.753274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:18.753682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:18.754449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] PATH_INFO: `/v3/projects/070bda4e77eb4ed9b1f828d2a8bb4235` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:18.756413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=070bda4e77eb4ed9b1f828d2a8bb4235)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:18.757858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:18.812895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070bda4e77eb4ed9b1f828d2a8bb4235', 'request_id': 'req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.823596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070bda4e77eb4ed9b1f828d2a8bb4235', 'request_id': 'req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.831114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070bda4e77eb4ed9b1f828d2a8bb4235', 'request_id': 'req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.845714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] The token cache is being invalidate because project 070bda4e77eb4ed9b1f828d2a8bb4235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:00:18.846142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.847141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:18.852919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1099/2195] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:00:18 2022] DELETE /identity/v3/projects/070bda4e77eb4ed9b1f828d2a8bb4235 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:18.855522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b3e50-6aba-4344-93eb-54a6cbc762de None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:18.871210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b3e50-6aba-4344-93eb-54a6cbc762de None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:18.942990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:18.947351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:18.947905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:18.948369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] PATH_INFO: `/v3/users/04d5cd9b90aa4c9c90c0a1f153749c39` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:18.950258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d5cd9b90aa4c9c90c0a1f153749c39)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:18.958322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:19.017915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d5cd9b90aa4c9c90c0a1f153749c39'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.018571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d5cd9b90aa4c9c90c0a1f153749c39'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.028210 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d5cd9b90aa4c9c90c0a1f153749c39'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.041568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d5cd9b90aa4c9c90c0a1f153749c39'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.048323 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d5cd9b90aa4c9c90c0a1f153749c39'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.057056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1097/2196] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:00:18 2022] DELETE /identity/v3/users/04d5cd9b90aa4c9c90c0a1f153749c39 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:19.595716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:19.597326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:19.611114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9b5b-29ce-4592-aa3c-1fc86d89c3ae admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:19.674799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:19.675680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:19.675962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:19.676236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] PATH_INFO: `/v3/projects/67d612ea1b5649b1b8d4af1ca0bc9e37` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:19.677481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d612ea1b5649b1b8d4af1ca0bc9e37)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:19.679409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:19.728308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d612ea1b5649b1b8d4af1ca0bc9e37', 'request_id': 'req-e688f980-42bb-47d2-bf29-ed277d2311fd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.736359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d612ea1b5649b1b8d4af1ca0bc9e37', 'request_id': 'req-e688f980-42bb-47d2-bf29-ed277d2311fd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.742695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d612ea1b5649b1b8d4af1ca0bc9e37', 'request_id': 'req-e688f980-42bb-47d2-bf29-ed277d2311fd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.755825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] The token cache is being invalidate because project 67d612ea1b5649b1b8d4af1ca0bc9e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:00:19.756120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.756889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.758657 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1100/2197] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:00:19 2022] DELETE /identity/v3/projects/67d612ea1b5649b1b8d4af1ca0bc9e37 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:19.762773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:19.764385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:19.777765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e4b86-1d8c-40a5-ab3d-e5a5c5f2b100 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:19.834532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:19.835798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:19.835798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:19.836023 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] PATH_INFO: `/v3/users/2d56c743f527461383e93e7292e22542` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:19.837193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d56c743f527461383e93e7292e22542)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:19.839235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:19.892560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d56c743f527461383e93e7292e22542'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.893465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d56c743f527461383e93e7292e22542'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.902050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d56c743f527461383e93e7292e22542'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.913905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d56c743f527461383e93e7292e22542'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.920813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1b757b5-e9c7-4afc-be64-8e2f4ff2b5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d56c743f527461383e93e7292e22542'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:19.926783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1098/2198] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:00:19 2022] DELETE /identity/v3/users/2d56c743f527461383e93e7292e22542 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:20.222194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:20.223840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:20.237465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f980-42bb-47d2-bf29-ed277d2311fd admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:20.296103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:20.296949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:20.297229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:20.297501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] PATH_INFO: `/v3/projects/2651bac231204e9faab32849b2cba9d9` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:20.298680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2651bac231204e9faab32849b2cba9d9)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:20.300589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:20.348318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2651bac231204e9faab32849b2cba9d9', 'request_id': 'req-be434137-0045-48bc-a599-9fe037e81c00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:20.356941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2651bac231204e9faab32849b2cba9d9', 'request_id': 'req-be434137-0045-48bc-a599-9fe037e81c00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:20.363229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2651bac231204e9faab32849b2cba9d9', 'request_id': 'req-be434137-0045-48bc-a599-9fe037e81c00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:20.373967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] The token cache is being invalidate because project 2651bac231204e9faab32849b2cba9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:00:20.374251 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:20.375345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:20.377068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1101/2199] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:00:20 2022] DELETE /identity/v3/projects/2651bac231204e9faab32849b2cba9d9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:24.923115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:24.924900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:24.925406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:24.959045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:24.961564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:25.052965 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1099/2200] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:00:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:25.105306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:25.107624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:25.183328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be434137-0045-48bc-a599-9fe037e81c00 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:25.188777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285fec4-181a-4c19-ab83-633a17b9eb2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:25.189564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fec4-181a-4c19-ab83-633a17b9eb2f service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:25.189968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fec4-181a-4c19-ab83-633a17b9eb2f service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:25.190334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fec4-181a-4c19-ab83-633a17b9eb2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:25.199726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285fec4-181a-4c19-ab83-633a17b9eb2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:25.201691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285fec4-181a-4c19-ab83-633a17b9eb2f service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:25.211338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1102/2201] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:00:40.336859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:40.338338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:40.412606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ccdb-46d9-4fba-aa04-062d6a6ff1d8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:40.417100 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:40.417976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.418253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.418521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] PATH_INFO: `/v3/users/7e560ca2695844fd8b7d7ac134f8a4b5` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.419703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e560ca2695844fd8b7d7ac134f8a4b5)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:40.421644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:40.458916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f012a-ad72-4f5f-af60-cfac95243f2c None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.459451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f012a-ad72-4f5f-af60-cfac95243f2c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.459451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f012a-ad72-4f5f-af60-cfac95243f2c None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.460899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1103/2202] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 19:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:00:40.468780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.469224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.469506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.485665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e560ca2695844fd8b7d7ac134f8a4b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:40.486326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e560ca2695844fd8b7d7ac134f8a4b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:40.496559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e560ca2695844fd8b7d7ac134f8a4b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:40.511164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e560ca2695844fd8b7d7ac134f8a4b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:40.518597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-88381171-c384-468f-9b0e-63ee2a4c761c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e560ca2695844fd8b7d7ac134f8a4b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:40.524947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1100/2203] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:00:40 2022] DELETE /identity/v3/users/7e560ca2695844fd8b7d7ac134f8a4b5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:40.529370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.529726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.530069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.531755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:40.533002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:40.548358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:40.549731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:40.611861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1101/2204] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:00:40.621601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1104/2205] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 19:00:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:40.624620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:40.626128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:40.633744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:40.635192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:40.681857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f7e15-f6df-4829-ab5c-752cc64a8966 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:40.686200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2969da-9ff9-4847-bb9b-2bf2d21a27ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:40.687052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2969da-9ff9-4847-bb9b-2bf2d21a27ac service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.687410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2969da-9ff9-4847-bb9b-2bf2d21a27ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.687796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2969da-9ff9-4847-bb9b-2bf2d21a27ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.690668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c5d13-7613-41e6-bdde-983de7192cbe None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:40.694572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fcca1-6f5e-411b-9c21-aec1ef476243 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:40.695704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fcca1-6f5e-411b-9c21-aec1ef476243 service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.695704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fcca1-6f5e-411b-9c21-aec1ef476243 service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.695924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fcca1-6f5e-411b-9c21-aec1ef476243 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.697935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2969da-9ff9-4847-bb9b-2bf2d21a27ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:40.699469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2969da-9ff9-4847-bb9b-2bf2d21a27ac service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:40.706703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fcca1-6f5e-411b-9c21-aec1ef476243 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:40.708274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fcca1-6f5e-411b-9c21-aec1ef476243 service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:40.709960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1102/2206] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:00:40.720084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1105/2207] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:00:40.788263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db307c-ad95-4c24-9c64-db4e8ef27a51 None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.788553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db307c-ad95-4c24-9c64-db4e8ef27a51 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.788887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db307c-ad95-4c24-9c64-db4e8ef27a51 None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.790536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1103/2208] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 19:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:00:40.795426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997063-b21c-44e4-b1af-9fdaea5850eb None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.795708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997063-b21c-44e4-b1af-9fdaea5850eb None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.795980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997063-b21c-44e4-b1af-9fdaea5850eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.815358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b0997063-b21c-44e4-b1af-9fdaea5850eb None None] MFA Rules not processed for user `945283f83c1b4ee0a1a59b0732090fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:40.816609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b0997063-b21c-44e4-b1af-9fdaea5850eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:40.824048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1106/2209] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 19:00:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:00:40.838518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db307c-ad95-4c24-9c64-db4e8ef27a51 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:40.840461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-01db307c-ad95-4c24-9c64-db4e8ef27a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:40.855927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db307c-ad95-4c24-9c64-db4e8ef27a51 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:40.859643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee953-d6f8-45d4-bdd8-4a7ed56e49d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:40.860321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee953-d6f8-45d4-bdd8-4a7ed56e49d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.860601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee953-d6f8-45d4-bdd8-4a7ed56e49d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.860909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee953-d6f8-45d4-bdd8-4a7ed56e49d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.868747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee953-d6f8-45d4-bdd8-4a7ed56e49d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:40.870219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee953-d6f8-45d4-bdd8-4a7ed56e49d4 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:40.879070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1104/2210] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:40.969081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cc584-65a7-447d-ae9d-aa8a18a11428 None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.969441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cc584-65a7-447d-ae9d-aa8a18a11428 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.969732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cc584-65a7-447d-ae9d-aa8a18a11428 None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.971342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1107/2211] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 19:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:00:40.977642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:40.977928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:40.978207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:40.997825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:40.999562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:41.024277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cc584-65a7-447d-ae9d-aa8a18a11428 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.024710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1105/2212] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 19:00:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:00:41.038556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cc584-65a7-447d-ae9d-aa8a18a11428 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.042308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9e72-3f27-44a6-8dbe-2aebbde1a0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.042965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9e72-3f27-44a6-8dbe-2aebbde1a0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.043700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9e72-3f27-44a6-8dbe-2aebbde1a0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.043700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9e72-3f27-44a6-8dbe-2aebbde1a0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.054723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9e72-3f27-44a6-8dbe-2aebbde1a0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.056179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9e72-3f27-44a6-8dbe-2aebbde1a0c3 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.067328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1108/2213] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:00:41.101101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.102676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:41.124882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b55534-cff5-483c-a58a-7745504d0efa None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.130883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.132007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.132297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.132641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] PATH_INFO: `/v3/projects/6dc3dce6010e45e29364df5b439507e0` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.134143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc3dce6010e45e29364df5b439507e0)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.136692 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.182453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc3dce6010e45e29364df5b439507e0', 'request_id': 'req-5c1869d5-9ce0-415d-b022-8693d088067a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:41.190767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc3dce6010e45e29364df5b439507e0', 'request_id': 'req-5c1869d5-9ce0-415d-b022-8693d088067a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:41.197931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc3dce6010e45e29364df5b439507e0', 'request_id': 'req-5c1869d5-9ce0-415d-b022-8693d088067a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:41.208090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] The token cache is being invalidate because project 6dc3dce6010e45e29364df5b439507e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:00:41.208395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:41.209209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5c1869d5-9ce0-415d-b022-8693d088067a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:41.210969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1106/2214] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:00:41 2022] DELETE /identity/v3/projects/6dc3dce6010e45e29364df5b439507e0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:41.215870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ad83b-53bc-42fb-a738-537c81e89eab None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.216231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ad83b-53bc-42fb-a738-537c81e89eab None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.216420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ad83b-53bc-42fb-a738-537c81e89eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.235397 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-991ad83b-53bc-42fb-a738-537c81e89eab None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:41.236656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-991ad83b-53bc-42fb-a738-537c81e89eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:41.295602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1109/2215] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:41.303951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f9bd-82bb-4142-b678-adc961010f11 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.304247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f9bd-82bb-4142-b678-adc961010f11 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.304529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f9bd-82bb-4142-b678-adc961010f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.324004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8497f9bd-82bb-4142-b678-adc961010f11 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:41.325254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8497f9bd-82bb-4142-b678-adc961010f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:41.333344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1107/2216] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:41.337727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ad83b-53bc-42fb-a738-537c81e89eab None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.347759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ad83b-53bc-42fb-a738-537c81e89eab None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.353200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.353852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.354133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.354409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.355143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:00:41.355449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.357079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.369306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1110/2217] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:00:41.374354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f9bd-82bb-4142-b678-adc961010f11 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.383976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f9bd-82bb-4142-b678-adc961010f11 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.389409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.390152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.390503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.390854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.391602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.393700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.421881 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1108/2218] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:00:41 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:00:41.426278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.437747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b59cf-ca05-4d50-aa0f-8f94f4ef8181 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.498458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.499463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.499751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.500025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.500734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.502666 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.523922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1111/2219] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:00:41 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:00:41.528030 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.539541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe77b-9577-4e14-bef3-77017191ac0b admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.544439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.545691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.545974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.546251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.546987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.548590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.559851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1109/2220] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:41.563791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.573745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aeb73-7009-4c74-9997-fd3df5ab3253 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.578714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca90c1-c04a-4294-ab70-a4cace8704c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.579589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca90c1-c04a-4294-ab70-a4cace8704c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.579872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca90c1-c04a-4294-ab70-a4cace8704c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.580152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca90c1-c04a-4294-ab70-a4cace8704c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.580876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca90c1-c04a-4294-ab70-a4cace8704c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.582664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca90c1-c04a-4294-ab70-a4cace8704c3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.593222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1112/2221] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:00:41.598737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.614109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50ffc-9371-4d66-b68f-3ea6d001105a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.619518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.620458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.620808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.621087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] PATH_INFO: `/v3/projects/f7830ddf97ed4de79ba9f48ae1347d7f/users/cdb7216e75704a1d8166ff9e6ef5ead3/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.642084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7830ddf97ed4de79ba9f48ae1347d7f, user_id=cdb7216e75704a1d8166ff9e6ef5ead3, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.644727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.659196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1110/2222] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:00:41 2022] PUT /identity/v3/projects/f7830ddf97ed4de79ba9f48ae1347d7f/users/cdb7216e75704a1d8166ff9e6ef5ead3/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:41.670320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f4e55-3ef6-4609-8b8b-df81ae09e700 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.670606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f4e55-3ef6-4609-8b8b-df81ae09e700 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.670881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f4e55-3ef6-4609-8b8b-df81ae09e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.708163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ed3f4e55-3ef6-4609-8b8b-df81ae09e700 None None] MFA Rules not processed for user `cdb7216e75704a1d8166ff9e6ef5ead3`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:41.709462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ed3f4e55-3ef6-4609-8b8b-df81ae09e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:41.777280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1113/2223] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:41.789177 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:41.791327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:41.879524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a133-eb38-436d-bf43-2b68a3945629 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:41.884203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:41.884904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:41.885180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:41.885459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:41.896034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:41.897565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:41.907803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1111/2224] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:43.851468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff1f0-7663-44fb-b1a8-1a740c7dfeba None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:43.851948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff1f0-7663-44fb-b1a8-1a740c7dfeba None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:43.852061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff1f0-7663-44fb-b1a8-1a740c7dfeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:43.874424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ce1ff1f0-7663-44fb-b1a8-1a740c7dfeba None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:43.875641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ce1ff1f0-7663-44fb-b1a8-1a740c7dfeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:43.948217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1114/2225] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:00:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:43.963384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:43.965121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:44.044655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef18e1-7e91-4d06-b0a1-4e834e067d39 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:44.050783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de35a26-7899-400f-9f85-4adb7af39920 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:44.051473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de35a26-7899-400f-9f85-4adb7af39920 service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:44.051776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de35a26-7899-400f-9f85-4adb7af39920 service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:44.052046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de35a26-7899-400f-9f85-4adb7af39920 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:44.061661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de35a26-7899-400f-9f85-4adb7af39920 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:44.063595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de35a26-7899-400f-9f85-4adb7af39920 service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:44.072184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1112/2226] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:00:52.133468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ff1f0-7663-44fb-b1a8-1a740c7dfeba None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:52.197300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ff1f0-7663-44fb-b1a8-1a740c7dfeba None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:52.202754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:52.203669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:52.203949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:52.204223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] PATH_INFO: `/v3/users/cdb7216e75704a1d8166ff9e6ef5ead3` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:52.205665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb7216e75704a1d8166ff9e6ef5ead3)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:52.207811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:52.263087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb7216e75704a1d8166ff9e6ef5ead3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:52.263696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb7216e75704a1d8166ff9e6ef5ead3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:52.276814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb7216e75704a1d8166ff9e6ef5ead3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:52.287647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb7216e75704a1d8166ff9e6ef5ead3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:52.294936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb7216e75704a1d8166ff9e6ef5ead3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:52.305451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1115/2227] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:00:52 2022] DELETE /identity/v3/users/cdb7216e75704a1d8166ff9e6ef5ead3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:00:52.307036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:52.307649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:52.307649 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:52.325200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:00:52.326599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:52.422215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1113/2228] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:00:52.441790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:52.443265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:52.507415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd295e-49b0-4543-8019-b8ac57ef398d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:52.511433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16ac9a-4913-4609-89ae-fdd444333aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:52.512123 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16ac9a-4913-4609-89ae-fdd444333aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:52.512452 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16ac9a-4913-4609-89ae-fdd444333aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:52.512901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16ac9a-4913-4609-89ae-fdd444333aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:52.529448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16ac9a-4913-4609-89ae-fdd444333aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:52.530600 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16ac9a-4913-4609-89ae-fdd444333aa7 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:52.542361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1116/2229] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:00:53.197874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:00:53.199456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:00:53.212549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f8f96-9c32-44dc-bb56-b561bb4320dc None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:00:53.218094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:00:53.218994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:00:53.219283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:00:53.219549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] PATH_INFO: `/v3/projects/f7830ddf97ed4de79ba9f48ae1347d7f` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:00:53.221029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7830ddf97ed4de79ba9f48ae1347d7f)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:00:53.222926 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:00:53.270793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7830ddf97ed4de79ba9f48ae1347d7f', 'request_id': 'req-c40fe603-3d3a-4b84-897e-3bf476af236a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:53.278451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7830ddf97ed4de79ba9f48ae1347d7f', 'request_id': 'req-c40fe603-3d3a-4b84-897e-3bf476af236a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:53.284904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7830ddf97ed4de79ba9f48ae1347d7f', 'request_id': 'req-c40fe603-3d3a-4b84-897e-3bf476af236a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:53.295239 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] The token cache is being invalidate because project f7830ddf97ed4de79ba9f48ae1347d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:00:53.295527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:53.296147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:00:53.297738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1114/2230] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:00:53 2022] DELETE /identity/v3/projects/f7830ddf97ed4de79ba9f48ae1347d7f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:01:07.246322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059855b-30fc-48ed-833e-a6083642466f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:01:07.246846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059855b-30fc-48ed-833e-a6083642466f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:01:07.246846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059855b-30fc-48ed-833e-a6083642466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:01:07.299398 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f059855b-30fc-48ed-833e-a6083642466f None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:01:07.300590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f059855b-30fc-48ed-833e-a6083642466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:01:07.376295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1117/2231] 10.222.0.52 () {58 vars in 967 bytes} [Tue May 10 19:01:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:01:07.393184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:01:07.395261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:01:07.497492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe603-3d3a-4b84-897e-3bf476af236a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:01:07.503445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f7754-d804-4f9a-9490-fe434c41a333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:01:07.504098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f7754-d804-4f9a-9490-fe434c41a333 service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:01:07.504376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f7754-d804-4f9a-9490-fe434c41a333 service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:01:07.504645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f7754-d804-4f9a-9490-fe434c41a333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:01:07.514282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f7754-d804-4f9a-9490-fe434c41a333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:01:07.515974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f7754-d804-4f9a-9490-fe434c41a333 service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:01:07.527912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1115/2232] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:01:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:01:16.869470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059855b-30fc-48ed-833e-a6083642466f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:01:16.871237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f059855b-30fc-48ed-833e-a6083642466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:01:16.966646 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059855b-30fc-48ed-833e-a6083642466f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:01:16.972147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578e1ee-56f7-4742-9596-b9fe00c66d0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:01:16.972887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e1ee-56f7-4742-9596-b9fe00c66d0a service placement] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:01:16.973173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e1ee-56f7-4742-9596-b9fe00c66d0a service placement] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:01:16.973446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e1ee-56f7-4742-9596-b9fe00c66d0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:01:16.975274 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9578e1ee-56f7-4742-9596-b9fe00c66d0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:01:16.987007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578e1ee-56f7-4742-9596-b9fe00c66d0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:01:16.988618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578e1ee-56f7-4742-9596-b9fe00c66d0a service placement] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:01:16.999248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1118/2233] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:01:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:01:26.839231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb7859-ade0-4ff5-9ff8-e92b975803ec None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:01:26.839748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb7859-ade0-4ff5-9ff8-e92b975803ec None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:01:26.839978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb7859-ade0-4ff5-9ff8-e92b975803ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:01:26.856906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-45cb7859-ade0-4ff5-9ff8-e92b975803ec None None] MFA Rules not processed for user `68b1c1f3865042b1bb208cc36b612c55`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:01:26.858185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-45cb7859-ade0-4ff5-9ff8-e92b975803ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:01:26.917240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1116/2234] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:01:43.917061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dee18-7504-4828-9e34-9f475674c830 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:01:43.917692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dee18-7504-4828-9e34-9f475674c830 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:01:43.917784 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dee18-7504-4828-9e34-9f475674c830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:01:43.937503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-457dee18-7504-4828-9e34-9f475674c830 None None] MFA Rules not processed for user `9d4785218d704599b5e3481ca05a4b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:01:43.938723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-457dee18-7504-4828-9e34-9f475674c830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:01:43.997303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1119/2235] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:01:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:01:55.502068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:01:55.502660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:01:55.502660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:01:55.521751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] MFA Rules not processed for user `ecc2540fdbe64849b897ae1b7cefe109`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:01:55.526938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:01:55.591547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1117/2236] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:01:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:02:44.215526 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be263dd-fb02-4e4b-8eb7-2ff63f3aa321 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:44.216054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be263dd-fb02-4e4b-8eb7-2ff63f3aa321 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:44.216174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be263dd-fb02-4e4b-8eb7-2ff63f3aa321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:44.234313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7be263dd-fb02-4e4b-8eb7-2ff63f3aa321 None None] MFA Rules not processed for user `a1ccfbe59f4841a093c71c75585fb2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:02:44.235534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7be263dd-fb02-4e4b-8eb7-2ff63f3aa321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:44.297423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1120/2237] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:02:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:02:51.320048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:51.321672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:51.400284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bfcd3-37a0-46b8-bc30-0a5c12169a69 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:51.405024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:51.405939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:51.406224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:51.406492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] PATH_INFO: `/v3/users/9d4785218d704599b5e3481ca05a4b8a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:51.407756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4785218d704599b5e3481ca05a4b8a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:51.409747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:51.459393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4785218d704599b5e3481ca05a4b8a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.460072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4785218d704599b5e3481ca05a4b8a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.468904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4785218d704599b5e3481ca05a4b8a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.484937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4785218d704599b5e3481ca05a4b8a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.493025 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4dca0295-18b0-4d98-9d61-8a0bd134eef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4785218d704599b5e3481ca05a4b8a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.499858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1118/2238] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:02:51 2022] DELETE /identity/v3/users/9d4785218d704599b5e3481ca05a4b8a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:02:51.673031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be263dd-fb02-4e4b-8eb7-2ff63f3aa321 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:51.687990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be263dd-fb02-4e4b-8eb7-2ff63f3aa321 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:51.757626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:51.759081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:51.759437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:51.759781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] PATH_INFO: `/v3/projects/772abdeeb78b4eaab9bc9d831eda68f3` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:51.761167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772abdeeb78b4eaab9bc9d831eda68f3)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:51.763155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:51.818923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772abdeeb78b4eaab9bc9d831eda68f3', 'request_id': 'req-a0d371c8-3299-4490-b92a-c8f1cc637c65'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.829528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772abdeeb78b4eaab9bc9d831eda68f3', 'request_id': 'req-a0d371c8-3299-4490-b92a-c8f1cc637c65'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.836540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772abdeeb78b4eaab9bc9d831eda68f3', 'request_id': 'req-a0d371c8-3299-4490-b92a-c8f1cc637c65'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.849291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] The token cache is being invalidate because project 772abdeeb78b4eaab9bc9d831eda68f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:02:51.849477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.850286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a0d371c8-3299-4490-b92a-c8f1cc637c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:02:51.855004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1121/2239] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:02:51 2022] DELETE /identity/v3/projects/772abdeeb78b4eaab9bc9d831eda68f3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:02:51.857595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97e927-655f-4518-bc40-dee9f61e4076 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:51.857893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97e927-655f-4518-bc40-dee9f61e4076 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:51.858213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97e927-655f-4518-bc40-dee9f61e4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:51.881358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ac97e927-655f-4518-bc40-dee9f61e4076 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:02:51.882539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ac97e927-655f-4518-bc40-dee9f61e4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:51.956722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1119/2240] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:02:51.971149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435ba0d-e16a-4bed-81e9-fe79221aaadf None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:51.971149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435ba0d-e16a-4bed-81e9-fe79221aaadf None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:51.971149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435ba0d-e16a-4bed-81e9-fe79221aaadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.004609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c435ba0d-e16a-4bed-81e9-fe79221aaadf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:02:52.005959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c435ba0d-e16a-4bed-81e9-fe79221aaadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:52.015896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1122/2241] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:02:52.020656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97e927-655f-4518-bc40-dee9f61e4076 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.030964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97e927-655f-4518-bc40-dee9f61e4076 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.035831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.036504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.036827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.037106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.037846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:02:52.038157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.039747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.055905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1120/2242] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:02:52.060402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435ba0d-e16a-4bed-81e9-fe79221aaadf None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.070641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435ba0d-e16a-4bed-81e9-fe79221aaadf None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.078317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.078317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.078668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.078668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.079617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.081533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.110977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1123/2243] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:02:52 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:02:52.115075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.125833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804db56-1001-45ab-95b8-4a5517e4def0 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.189678 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.190367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.190656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.190934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.191699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.193672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.216232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1121/2244] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:02:52 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:02:52.220620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.230733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f003948-ce08-4ec6-bdb5-de0d010efea1 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.235592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.236269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.236557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.236882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.237653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.239256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.252850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1124/2245] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:02:52.254516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.264453 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8a73-79fa-482a-b232-2b73be815478 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.270029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555faac-99d9-43e1-8ba8-3a668cf065a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.270202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555faac-99d9-43e1-8ba8-3a668cf065a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.270438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555faac-99d9-43e1-8ba8-3a668cf065a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.270717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555faac-99d9-43e1-8ba8-3a668cf065a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.271493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555faac-99d9-43e1-8ba8-3a668cf065a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.273254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555faac-99d9-43e1-8ba8-3a668cf065a9 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.284738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1122/2246] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:02:52.288160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.299017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758088b-fcb5-40ad-993c-33df6c18f1ff admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.304488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.305511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.305834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.306124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] PATH_INFO: `/v3/projects/6ef1ab99c3f845fb967283cde091b168/users/179a4a10f23f401ea02ff013f385b1bd/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.323159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef1ab99c3f845fb967283cde091b168, user_id=179a4a10f23f401ea02ff013f385b1bd, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.325841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.345615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1125/2247] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:02:52 2022] PUT /identity/v3/projects/6ef1ab99c3f845fb967283cde091b168/users/179a4a10f23f401ea02ff013f385b1bd/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:02:52.356240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b190a0-7240-4576-8515-bdced59f8342 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.356805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b190a0-7240-4576-8515-bdced59f8342 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.356805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b190a0-7240-4576-8515-bdced59f8342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.386444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-54b190a0-7240-4576-8515-bdced59f8342 None None] MFA Rules not processed for user `179a4a10f23f401ea02ff013f385b1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:02:52.387711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-54b190a0-7240-4576-8515-bdced59f8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:52.486074 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1123/2248] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:02:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:02:52.487128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.559288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d71cb-2af0-49a0-96fb-c8fc9183109e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.569428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.570142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.570454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.570734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.571486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.573528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.601611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1126/2249] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:02:52 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:02:52.605648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b190a0-7240-4576-8515-bdced59f8342 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.619349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b190a0-7240-4576-8515-bdced59f8342 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.685421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.686108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.686390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.686671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.687366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.689473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.714478 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1124/2250] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:02:52 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:02:52.715661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.728469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ded1-0393-4bd6-b7fa-87b51f2bd4e9 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.734792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.735534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.735979 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.736459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.737231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.738839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.750243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1127/2251] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:02:52.754764 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.764868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033159ea-295b-40c4-872e-712a63f3dab3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.769733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.770650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.770927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.771198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] PATH_INFO: `/v3/projects/f83f7069720c497883f35349afb8e01c/users/ca7a426c6a214ad5a97526cc01b4f39e/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.785597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83f7069720c497883f35349afb8e01c, user_id=ca7a426c6a214ad5a97526cc01b4f39e, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.788257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.805610 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1125/2252] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:02:52 2022] PUT /identity/v3/projects/f83f7069720c497883f35349afb8e01c/users/ca7a426c6a214ad5a97526cc01b4f39e/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:02:52.809779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.820073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a619-41e5-4621-9e22-fccd17908dba admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.873763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e506a6-3891-4578-ba07-92aa58594203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.874331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e506a6-3891-4578-ba07-92aa58594203 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.874619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e506a6-3891-4578-ba07-92aa58594203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.874987 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e506a6-3891-4578-ba07-92aa58594203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.875761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e506a6-3891-4578-ba07-92aa58594203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.877446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e506a6-3891-4578-ba07-92aa58594203 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.887180 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1128/2253] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:02:52.891578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:52.902077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed81b-43e0-4ace-a13e-132f9416a54d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:52.906892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:52.907780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.908070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.908348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] PATH_INFO: `/v3/projects/f83f7069720c497883f35349afb8e01c/users/ca7a426c6a214ad5a97526cc01b4f39e/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.910419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83f7069720c497883f35349afb8e01c, user_id=ca7a426c6a214ad5a97526cc01b4f39e, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:52.913250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:52.923915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1126/2254] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:02:52 2022] PUT /identity/v3/projects/f83f7069720c497883f35349afb8e01c/users/ca7a426c6a214ad5a97526cc01b4f39e/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:02:52.935519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57018-52a2-4e6d-888b-81d97512f647 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:52.935807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57018-52a2-4e6d-888b-81d97512f647 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:52.936118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57018-52a2-4e6d-888b-81d97512f647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:52.961883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-27a57018-52a2-4e6d-888b-81d97512f647 None None] MFA Rules not processed for user `ca7a426c6a214ad5a97526cc01b4f39e`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:02:52.963107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-27a57018-52a2-4e6d-888b-81d97512f647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:53.031761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1129/2255] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:02:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:02:53.043106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:53.044980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:53.108131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf979ffe-6f77-467d-8457-af10198f9e98 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:53.112293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:53.113278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:53.113497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:53.113751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:53.184309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:53.185857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:53.196118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1127/2256] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:02:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:02:54.528145 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:54.528649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:54.528990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:54.547500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] MFA Rules not processed for user `68b1c1f3865042b1bb208cc36b612c55`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:02:54.548710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:54.609895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1130/2257] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:02:57.871389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:02:57.872832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:02:57.886604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835e4b8-87a1-48f4-aca9-7b7681f2498b service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:02:57.890280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:02:57.890979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:02:57.891228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:02:57.891505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:02:57.903874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:02:57.905491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:02:57.915503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1128/2258] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:02:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:08.716791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:08.718425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:08.777318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecbdb0-6b82-435d-afe5-cd0045991497 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:08.781242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b370871-b76a-45ca-8fc5-927446b7df83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:08.781914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b370871-b76a-45ca-8fc5-927446b7df83 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:08.782192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b370871-b76a-45ca-8fc5-927446b7df83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:08.782463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b370871-b76a-45ca-8fc5-927446b7df83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:08.784396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3b370871-b76a-45ca-8fc5-927446b7df83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:08.855652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b370871-b76a-45ca-8fc5-927446b7df83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:08.857213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b370871-b76a-45ca-8fc5-927446b7df83 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:08.868058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1131/2259] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:12.497508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:12.499013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:12.511098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d6bb-c9a4-4d39-8bd8-29f57088db12 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:12.515005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:12.515663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:12.515944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:12.516220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:12.518076 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:12.537530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:12.539079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:12.553855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1129/2260] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:19.095849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59591525-1af9-41a2-863c-cdf347c581b2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:19.096638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59591525-1af9-41a2-863c-cdf347c581b2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:19.096638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59591525-1af9-41a2-863c-cdf347c581b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:19.119036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-59591525-1af9-41a2-863c-cdf347c581b2 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:19.121164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-59591525-1af9-41a2-863c-cdf347c581b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:19.181443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1132/2261] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:19.234095 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:19.235667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:19.307261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab283ff-283f-4b6e-b676-1160c93458fe service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:19.313152 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bcc05-d31a-4def-8f05-3664a841a4b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:19.313821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bcc05-d31a-4def-8f05-3664a841a4b9 service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:19.314108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bcc05-d31a-4def-8f05-3664a841a4b9 service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:19.314440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bcc05-d31a-4def-8f05-3664a841a4b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:19.322843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bcc05-d31a-4def-8f05-3664a841a4b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:19.324487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bcc05-d31a-4def-8f05-3664a841a4b9 service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:19.334383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1130/2262] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:03:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:03:22.220565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59591525-1af9-41a2-863c-cdf347c581b2 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:22.294821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59591525-1af9-41a2-863c-cdf347c581b2 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:22.299650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:22.300869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:22.301229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:22.301573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] PATH_INFO: `/v3/users/179a4a10f23f401ea02ff013f385b1bd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:22.302936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179a4a10f23f401ea02ff013f385b1bd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:22.305239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:22.366761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179a4a10f23f401ea02ff013f385b1bd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:22.368196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179a4a10f23f401ea02ff013f385b1bd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:22.385247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179a4a10f23f401ea02ff013f385b1bd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:22.395162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179a4a10f23f401ea02ff013f385b1bd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:22.403658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179a4a10f23f401ea02ff013f385b1bd'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:22.413392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1133/2263] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:03:22 2022] DELETE /identity/v3/users/179a4a10f23f401ea02ff013f385b1bd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:22.415954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:22.416918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:22.417405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:22.447598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:22.449853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:22.531172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1131/2264] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:22.541054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:22.542798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:22.642662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27a1c-bddb-438a-9245-ad4800a00767 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:22.646791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:22.647550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:22.647901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:22.648248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:22.658337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:22.659865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:22.674845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1134/2265] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:03:23.129432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:23.131939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:23.174811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d39a-c362-4dc1-9b13-73de239ca27a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:23.192775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:23.194069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:23.196639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:23.197064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] PATH_INFO: `/v3/projects/6ef1ab99c3f845fb967283cde091b168` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:23.199888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef1ab99c3f845fb967283cde091b168)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:23.205632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:23.273847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef1ab99c3f845fb967283cde091b168', 'request_id': 'req-aa6b6867-7602-4634-90cf-64486401e783'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.289720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef1ab99c3f845fb967283cde091b168', 'request_id': 'req-aa6b6867-7602-4634-90cf-64486401e783'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.298490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef1ab99c3f845fb967283cde091b168', 'request_id': 'req-aa6b6867-7602-4634-90cf-64486401e783'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.325378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] The token cache is being invalidate because project 6ef1ab99c3f845fb967283cde091b168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:03:23.325648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.326309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.328161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1132/2266] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:03:23 2022] DELETE /identity/v3/projects/6ef1ab99c3f845fb967283cde091b168 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:23.332059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:23.347552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03e48-e003-42cf-88f0-b3555f0024e1 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:23.463506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:23.465041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:23.465474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:23.465896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] PATH_INFO: `/v3/users/ca7a426c6a214ad5a97526cc01b4f39e` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:23.467290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7a426c6a214ad5a97526cc01b4f39e)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:23.469484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:23.556819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7a426c6a214ad5a97526cc01b4f39e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.557940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7a426c6a214ad5a97526cc01b4f39e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.578405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7a426c6a214ad5a97526cc01b4f39e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.593266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7a426c6a214ad5a97526cc01b4f39e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.601615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ed1cf168-f96d-4841-a484-267c1cf4e06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7a426c6a214ad5a97526cc01b4f39e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:23.610922 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1135/2267] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:03:23 2022] DELETE /identity/v3/users/ca7a426c6a214ad5a97526cc01b4f39e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:24.023206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.025552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:24.047011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6867-7602-4634-90cf-64486401e783 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:24.121916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:24.122792 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.123069 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.123342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] PATH_INFO: `/v3/projects/f83f7069720c497883f35349afb8e01c` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.125196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83f7069720c497883f35349afb8e01c)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:24.126983 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:24.224161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83f7069720c497883f35349afb8e01c', 'request_id': 'req-61402cec-a9ba-43c5-b25b-196d0ff6cca1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:24.238416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83f7069720c497883f35349afb8e01c', 'request_id': 'req-61402cec-a9ba-43c5-b25b-196d0ff6cca1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:24.250306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83f7069720c497883f35349afb8e01c', 'request_id': 'req-61402cec-a9ba-43c5-b25b-196d0ff6cca1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:24.261294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] The token cache is being invalidate because project f83f7069720c497883f35349afb8e01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:03:24.261579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:24.262248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-61402cec-a9ba-43c5-b25b-196d0ff6cca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:24.264110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1133/2268] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:03:24 2022] DELETE /identity/v3/projects/f83f7069720c497883f35349afb8e01c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:24.269552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3831-97ec-4c19-b786-8566e4cd1563 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.269920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3831-97ec-4c19-b786-8566e4cd1563 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.270262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3831-97ec-4c19-b786-8566e4cd1563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.291839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-0f7e3831-97ec-4c19-b786-8566e4cd1563 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:24.293498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0f7e3831-97ec-4c19-b786-8566e4cd1563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:24.368783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1136/2269] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:24.377505 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0791c3-2d08-4aa5-9bec-fd0950f4178c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.377977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0791c3-2d08-4aa5-9bec-fd0950f4178c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.378439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0791c3-2d08-4aa5-9bec-fd0950f4178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.398219 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-cd0791c3-2d08-4aa5-9bec-fd0950f4178c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:24.399447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cd0791c3-2d08-4aa5-9bec-fd0950f4178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:24.408249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1134/2270] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:24.412664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3831-97ec-4c19-b786-8566e4cd1563 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.423790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3831-97ec-4c19-b786-8566e4cd1563 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:24.429642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:24.430174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.430460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.430740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.431881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:03:24.431881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:24.433492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:24.446059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1137/2271] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:03:24.451545 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0791c3-2d08-4aa5-9bec-fd0950f4178c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.462215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0791c3-2d08-4aa5-9bec-fd0950f4178c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:24.471156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:24.471849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.472131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.472418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.473318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:24.475345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:24.508826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1135/2272] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:03:24 2022] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:24.513158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.523894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33116e93-7f2d-43c3-a00f-31b5b4f1ab19 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:24.593262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:24.594191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.594567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.594944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.595785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:24.597968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:24.622633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1138/2273] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:03:24 2022] POST /identity/v3/users => generated 304 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:24.626398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.637527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42d028-d249-462a-a708-bcb9ad6fca21 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:24.643640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:24.644337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.644547 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.645060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.645652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:24.647251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:24.659214 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1136/2274] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:03:24.662890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.673425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef869e29-03c1-4541-b167-3db51d86a5b2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:24.678471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d504f-5f42-4477-a1ae-2ab71d0ba7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:24.679144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d504f-5f42-4477-a1ae-2ab71d0ba7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.679659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d504f-5f42-4477-a1ae-2ab71d0ba7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.679768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d504f-5f42-4477-a1ae-2ab71d0ba7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.680429 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d504f-5f42-4477-a1ae-2ab71d0ba7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:24.682272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d504f-5f42-4477-a1ae-2ab71d0ba7d0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:24.695294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1139/2275] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:03:24.700510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.713430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcde67-c823-4431-966f-c4931b993ef5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:24.719528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:24.720517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.723436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.723436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] PATH_INFO: `/v3/projects/52b843e9f5fe44a6bc3d124a30a4b38a/users/6a904e47873345448eeebb5a71c02721/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.748417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b843e9f5fe44a6bc3d124a30a4b38a, user_id=6a904e47873345448eeebb5a71c02721, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:24.751230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:24.771244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1137/2276] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:24 2022] PUT /identity/v3/projects/52b843e9f5fe44a6bc3d124a30a4b38a/users/6a904e47873345448eeebb5a71c02721/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:03:24.782880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce79d2-c351-4ee6-8b21-1358135420b3 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:24.783315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce79d2-c351-4ee6-8b21-1358135420b3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:24.783904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce79d2-c351-4ee6-8b21-1358135420b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:24.822877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-01ce79d2-c351-4ee6-8b21-1358135420b3 None None] MFA Rules not processed for user `6a904e47873345448eeebb5a71c02721`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:24.825069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-01ce79d2-c351-4ee6-8b21-1358135420b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:24.920866 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1140/2277] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:24.925342 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:24.995442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160c12d-f03d-41d5-9ed5-ede67eb893c8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.003423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.004142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.004429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.004756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.005522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.007599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.040401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1138/2278] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:03:24 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:03:25.046216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce79d2-c351-4ee6-8b21-1358135420b3 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:25.060183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce79d2-c351-4ee6-8b21-1358135420b3 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.123221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.123934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.124219 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.124500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.125319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.127602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.149239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1141/2279] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:03:25 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:25.153444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:25.164040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7b7e0-b2f4-4be0-8540-bb981b33ff79 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.168805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.169504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.169781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.170085 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.170829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.172438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.187379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1139/2280] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:03:25.192148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:25.211584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa30fc-6196-4faf-9a76-d4b9521bd466 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.219588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.220630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.220949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.221226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] PATH_INFO: `/v3/projects/044230990286422a81a564432a323a66/users/408ebe55389f4379b9340616af5271fc/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.237809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044230990286422a81a564432a323a66, user_id=408ebe55389f4379b9340616af5271fc, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.240546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.257271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1142/2281] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:25 2022] PUT /identity/v3/projects/044230990286422a81a564432a323a66/users/408ebe55389f4379b9340616af5271fc/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:03:25.261587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:25.272028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582770-355b-4ca6-a6b5-ec06bb6d8365 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.337725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e221-a568-4cca-b20d-296dd5043444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.338312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e221-a568-4cca-b20d-296dd5043444 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.338595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e221-a568-4cca-b20d-296dd5043444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.338870 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e221-a568-4cca-b20d-296dd5043444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.339643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e221-a568-4cca-b20d-296dd5043444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.342653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e221-a568-4cca-b20d-296dd5043444 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.351911 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1140/2282] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:03:25.357376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:25.369749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25ab6-31d2-4e9f-95cd-4df06649e809 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.374807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.375696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.375992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.376250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] PATH_INFO: `/v3/projects/044230990286422a81a564432a323a66/users/408ebe55389f4379b9340616af5271fc/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.378302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=044230990286422a81a564432a323a66, user_id=408ebe55389f4379b9340616af5271fc, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.380996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.391187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1143/2283] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:25 2022] PUT /identity/v3/projects/044230990286422a81a564432a323a66/users/408ebe55389f4379b9340616af5271fc/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:03:25.402563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a7d6b-6767-45eb-8c02-264a795befae None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.402854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a7d6b-6767-45eb-8c02-264a795befae None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.403129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a7d6b-6767-45eb-8c02-264a795befae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.446501 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-dc9a7d6b-6767-45eb-8c02-264a795befae None None] MFA Rules not processed for user `408ebe55389f4379b9340616af5271fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:25.447895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-dc9a7d6b-6767-45eb-8c02-264a795befae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:25.538647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1141/2284] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:25.552288 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:25.555308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:25.622864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c711a-791a-4140-a39a-c053cf177b2a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.627134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.627856 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.628143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.628424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.640376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.641896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.654930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1144/2285] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:25.829852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a7d6b-6767-45eb-8c02-264a795befae None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:25.841537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a7d6b-6767-45eb-8c02-264a795befae None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:25.845125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:25.845889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:25.846158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:25.846428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:25.907600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:25.909143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:25.919319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1142/2286] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:29.466519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:29.468755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:29.511635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:29.513327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:29.552324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0782b-1cd7-47c5-8f1e-81ab3dddda45 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:29.556492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:29.557172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:29.557457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:29.557726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:29.559817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:29.587558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bf832-2b92-48ef-a7d3-38c6414fbe55 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:29.593410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:29.594094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:29.594530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:29.594763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:29.601598 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:29.621169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:29.622692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:29.631929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1145/2287] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:29.665347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:29.666959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:29.675834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1143/2288] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:31.006080 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:31.008159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:31.065470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c170ca-7b97-465e-be89-255d148b62d2 service glance] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:31.069071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca5871-c933-400e-ba2f-be1e316d94ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:31.069726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca5871-c933-400e-ba2f-be1e316d94ee service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:31.070003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca5871-c933-400e-ba2f-be1e316d94ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:31.070279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca5871-c933-400e-ba2f-be1e316d94ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:31.072037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-64ca5871-c933-400e-ba2f-be1e316d94ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:31.081279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca5871-c933-400e-ba2f-be1e316d94ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:31.082703 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca5871-c933-400e-ba2f-be1e316d94ee service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:31.090322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1146/2289] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:33.374191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:33.435257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d486ae-025d-4b53-9513-1fd95ef8379b service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:33.440000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:33.440880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:33.441159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:33.441431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] PATH_INFO: `/v3/users/6a904e47873345448eeebb5a71c02721` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:33.442756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a904e47873345448eeebb5a71c02721)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:33.444661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:33.490673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a904e47873345448eeebb5a71c02721'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:33.491335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a904e47873345448eeebb5a71c02721'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:33.501284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a904e47873345448eeebb5a71c02721'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:33.514090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a904e47873345448eeebb5a71c02721'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:33.520635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a904e47873345448eeebb5a71c02721'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:33.526626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1144/2290] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:03:33 2022] DELETE /identity/v3/users/6a904e47873345448eeebb5a71c02721 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:33.531302 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:33.531834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:33.531991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:33.550818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:33.552222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:33.609984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1147/2291] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:33.620562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:33.622056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:33.685009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce22a-86bb-4cfb-bf35-ce462a3b9590 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:33.689269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:33.689918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:33.690195 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:33.690460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:33.700006 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:33.701559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:33.710980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1145/2292] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:33.993859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:33.995610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:34.009782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc52f7-2802-4a9a-a36f-4357288d5a5b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:34.015977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:34.016880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:34.017158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:34.017429 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] PATH_INFO: `/v3/projects/52b843e9f5fe44a6bc3d124a30a4b38a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:34.018701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b843e9f5fe44a6bc3d124a30a4b38a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:34.020700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:34.068578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b843e9f5fe44a6bc3d124a30a4b38a', 'request_id': 'req-418e211b-7340-4c87-90f6-b97739f88fa8'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.077949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b843e9f5fe44a6bc3d124a30a4b38a', 'request_id': 'req-418e211b-7340-4c87-90f6-b97739f88fa8'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.084618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b843e9f5fe44a6bc3d124a30a4b38a', 'request_id': 'req-418e211b-7340-4c87-90f6-b97739f88fa8'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.094977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] The token cache is being invalidate because project 52b843e9f5fe44a6bc3d124a30a4b38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:03:34.095266 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.095938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.097604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1148/2293] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:03:33 2022] DELETE /identity/v3/projects/52b843e9f5fe44a6bc3d124a30a4b38a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:34.101952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:34.111573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd3e42-606d-4965-84ac-2e3a6ddf3857 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:34.172120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:34.172963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:34.173245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:34.173521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] PATH_INFO: `/v3/users/408ebe55389f4379b9340616af5271fc` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:34.174738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408ebe55389f4379b9340616af5271fc)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:34.176743 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:34.226065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408ebe55389f4379b9340616af5271fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.226763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408ebe55389f4379b9340616af5271fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.235167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408ebe55389f4379b9340616af5271fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.247962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408ebe55389f4379b9340616af5271fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.254906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e334c09a-ea05-4067-9a87-6d9319024c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408ebe55389f4379b9340616af5271fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.260938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1146/2294] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:03:34 2022] DELETE /identity/v3/users/408ebe55389f4379b9340616af5271fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:34.631150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:34.633329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:34.649147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e211b-7340-4c87-90f6-b97739f88fa8 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:34.715010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:34.716066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:34.716353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:34.716628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] PATH_INFO: `/v3/projects/044230990286422a81a564432a323a66` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:34.717981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=044230990286422a81a564432a323a66)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:34.719879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:34.769432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044230990286422a81a564432a323a66', 'request_id': 'req-a892bbbb-7c95-4afa-9573-2d0d3064f34f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.777921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044230990286422a81a564432a323a66', 'request_id': 'req-a892bbbb-7c95-4afa-9573-2d0d3064f34f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.784248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044230990286422a81a564432a323a66', 'request_id': 'req-a892bbbb-7c95-4afa-9573-2d0d3064f34f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.794885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] The token cache is being invalidate because project 044230990286422a81a564432a323a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:03:34.795254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.796009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a892bbbb-7c95-4afa-9573-2d0d3064f34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:34.798396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1149/2295] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:03:34 2022] DELETE /identity/v3/projects/044230990286422a81a564432a323a66 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:03:34.803389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656e87-6a11-494f-947e-646961a20d7c None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:34.803900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656e87-6a11-494f-947e-646961a20d7c None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:34.804045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656e87-6a11-494f-947e-646961a20d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:34.823008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-bd656e87-6a11-494f-947e-646961a20d7c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:34.824253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-bd656e87-6a11-494f-947e-646961a20d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:34.885737 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1147/2296] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:34.893769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f93e8b-74df-474e-856c-5415678e828b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:34.894083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f93e8b-74df-474e-856c-5415678e828b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:34.894361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f93e8b-74df-474e-856c-5415678e828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:34.913782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b4f93e8b-74df-474e-856c-5415678e828b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:34.915193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b4f93e8b-74df-474e-856c-5415678e828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:34.924201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1150/2297] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:34.928788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656e87-6a11-494f-947e-646961a20d7c None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:34.938675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656e87-6a11-494f-947e-646961a20d7c None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:34.943961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:34.944624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:34.944962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:34.945238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:34.945972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:03:34.946280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:34.947868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:34.959850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1148/2298] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:03:34.965475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f93e8b-74df-474e-856c-5415678e828b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:34.974775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f93e8b-74df-474e-856c-5415678e828b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:34.979483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:34.980170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:34.980449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:34.980752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:34.981446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:34.983451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.009269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1151/2299] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:03:34 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:35.013200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.023331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7de56-3594-48a7-9df5-8eac2874e259 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.083596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.084280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.084569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.084923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.085827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.087971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.109396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1149/2300] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:03:35 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:35.113737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.125676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c755314-0ac8-4d5c-9ae6-e07602c2b0a2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.130771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.131553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.131834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.132087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.132876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.134490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.145009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1152/2301] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:03:35.149290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.159498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4159a-558f-4ea3-b03c-31996bbe5f3a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.164228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca253c-bb44-47f1-ae51-c1c805626cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.164921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca253c-bb44-47f1-ae51-c1c805626cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.165203 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca253c-bb44-47f1-ae51-c1c805626cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.165531 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca253c-bb44-47f1-ae51-c1c805626cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.166227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca253c-bb44-47f1-ae51-c1c805626cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.167798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca253c-bb44-47f1-ae51-c1c805626cb3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.178067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1150/2302] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:03:35.182398 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.192261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0888f0-57ae-4c36-83c6-374aea7a73eb admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.197110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.197980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.198258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.198531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] PATH_INFO: `/v3/projects/1c0c5b7666ac4429b8cb6ffd1154b797/users/05eb45280be84a17a4818333c99e7efe/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.213937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0c5b7666ac4429b8cb6ffd1154b797, user_id=05eb45280be84a17a4818333c99e7efe, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.218070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.233184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1153/2303] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:35 2022] PUT /identity/v3/projects/1c0c5b7666ac4429b8cb6ffd1154b797/users/05eb45280be84a17a4818333c99e7efe/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:03:35.246001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.246305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.246576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.275052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] MFA Rules not processed for user `05eb45280be84a17a4818333c99e7efe`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:35.276270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:35.344504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1151/2304] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:35.349085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.388280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.389768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:35.414358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefd8e9-7b70-40b7-817a-016177a0e989 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.419081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.419773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.420052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.420324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.421065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.422988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.448005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6a8b-7143-4cca-b9f1-067068235044 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.449420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1154/2305] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:03:35 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:35.453434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.499819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.500479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.500800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.501089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.502956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:35.512709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.513585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bffba1-4dee-4eae-8777-890601339eb9 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.514154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.518346 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.519018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.519300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.519575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.520258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.522236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1152/2306] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:03:35.522352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.542742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1155/2307] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:03:35 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:35.547093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.558961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3c175-0ef6-4495-8a49-2ed5a138b0c5 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.563724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8e3dd-12d5-4686-aad7-b468b6bcf1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.564585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8e3dd-12d5-4686-aad7-b468b6bcf1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.564972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8e3dd-12d5-4686-aad7-b468b6bcf1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.565292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8e3dd-12d5-4686-aad7-b468b6bcf1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.566168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8e3dd-12d5-4686-aad7-b468b6bcf1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.568331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8e3dd-12d5-4686-aad7-b468b6bcf1f7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.582474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1153/2308] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:03:35.583939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.595790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e19d35-6f6b-4e8e-bd25-8b979c661a46 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.601895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.602794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.603232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.603516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] PATH_INFO: `/v3/projects/6d6b438ac1e6464b9b8df79bd2c7825e/users/55b5fbdb3f3e4fbf8918ea42fccee816/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.620567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6b438ac1e6464b9b8df79bd2c7825e, user_id=55b5fbdb3f3e4fbf8918ea42fccee816, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.623455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.628634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0f54-089a-49dd-b087-63038b0d88de None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.629026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0f54-089a-49dd-b087-63038b0d88de None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.629427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0f54-089a-49dd-b087-63038b0d88de None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.631315 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1154/2309] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 19:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:03:35.637458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.637840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.638182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.639163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1156/2310] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:35 2022] PUT /identity/v3/projects/6d6b438ac1e6464b9b8df79bd2c7825e/users/55b5fbdb3f3e4fbf8918ea42fccee816/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:35.642702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.658538 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:35.659905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:35.708810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b19ae-6acd-41f4-a49c-8aa8468e7d78 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.713596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.714384 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.714569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.715031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.715560 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.717225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.727783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1157/2311] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:03:35.731688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.735003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1155/2312] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:03:35.744336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcffca1-1d4f-4da0-aebf-d179d9dffcf0 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.750487 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa948f7-b8a3-46da-94e3-e285946498b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.751387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa948f7-b8a3-46da-94e3-e285946498b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.751669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa948f7-b8a3-46da-94e3-e285946498b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.751945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa948f7-b8a3-46da-94e3-e285946498b3 admin admin] PATH_INFO: `/v3/projects/6d6b438ac1e6464b9b8df79bd2c7825e/users/55b5fbdb3f3e4fbf8918ea42fccee816/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.753344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.754333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa948f7-b8a3-46da-94e3-e285946498b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6b438ac1e6464b9b8df79bd2c7825e, user_id=55b5fbdb3f3e4fbf8918ea42fccee816, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.754908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:35.766997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa948f7-b8a3-46da-94e3-e285946498b3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.769380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1158/2313] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:35 2022] PUT /identity/v3/projects/6d6b438ac1e6464b9b8df79bd2c7825e/users/55b5fbdb3f3e4fbf8918ea42fccee816/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:03:35.779382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.779667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.779942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.805383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] MFA Rules not processed for user `55b5fbdb3f3e4fbf8918ea42fccee816`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:35.806578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:35.810065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ac70-7c0b-42bf-80a1-ac4cbe7751b2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.856752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f8a8-21dd-43ca-b624-9e3793de733c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.857524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f8a8-21dd-43ca-b624-9e3793de733c service glance] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.857812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f8a8-21dd-43ca-b624-9e3793de733c service glance] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.858090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f8a8-21dd-43ca-b624-9e3793de733c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.873124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1159/2314] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:03:35.885173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:35.887799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:35.934412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f8a8-21dd-43ca-b624-9e3793de733c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.935902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f8a8-21dd-43ca-b624-9e3793de733c service glance] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.947143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c5703-5d3f-44b5-8880-c7c97e60b5bc None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:35.947377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1156/2315] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:03:35.951036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b326ca-41d0-4d77-8e28-54f676ebd221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:35.951823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b326ca-41d0-4d77-8e28-54f676ebd221 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:35.952113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b326ca-41d0-4d77-8e28-54f676ebd221 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:35.952391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b326ca-41d0-4d77-8e28-54f676ebd221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:35.962732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b326ca-41d0-4d77-8e28-54f676ebd221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:35.964128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b326ca-41d0-4d77-8e28-54f676ebd221 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:35.975921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1160/2316] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:36.033114 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6632dd4-cb5e-4dba-b7aa-9e36d1a77b2f None None] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.033398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6632dd4-cb5e-4dba-b7aa-9e36d1a77b2f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.033702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6632dd4-cb5e-4dba-b7aa-9e36d1a77b2f None None] PATH_INFO: `/` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.035667 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1157/2317] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 19:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:03:36.040517 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf300-2dca-4334-92f7-bc978113c4f4 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.040888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf300-2dca-4334-92f7-bc978113c4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.041200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf300-2dca-4334-92f7-bc978113c4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.061376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a76cf300-2dca-4334-92f7-bc978113c4f4 None None] MFA Rules not processed for user `945283f83c1b4ee0a1a59b0732090fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:36.062689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a76cf300-2dca-4334-92f7-bc978113c4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:36.116713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1161/2318] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:36.128421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6632dd4-cb5e-4dba-b7aa-9e36d1a77b2f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:36.130343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b6632dd4-cb5e-4dba-b7aa-9e36d1a77b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:36.143263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6632dd4-cb5e-4dba-b7aa-9e36d1a77b2f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:36.146910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a4953-7c11-4ece-a4e0-0f04f5798c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:36.147548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4953-7c11-4ece-a4e0-0f04f5798c55 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.147826 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4953-7c11-4ece-a4e0-0f04f5798c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.148091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4953-7c11-4ece-a4e0-0f04f5798c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.155950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a4953-7c11-4ece-a4e0-0f04f5798c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:36.157413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a4953-7c11-4ece-a4e0-0f04f5798c55 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:36.166925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1158/2319] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:36.253446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ceff-026a-4366-a4d3-0c0867bc636f None None] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.253734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ceff-026a-4366-a4d3-0c0867bc636f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.254023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ceff-026a-4366-a4d3-0c0867bc636f None None] PATH_INFO: `/` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.255492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1162/2320] 10.222.0.52 () {54 vars in 921 bytes} [Tue May 10 19:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:03:36.261723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.262016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.262291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.280398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] MFA Rules not processed for user `dff69f29cd4341f488887fea0dd2e540`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:36.281620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:36.291184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1159/2321] 10.222.0.52 () {58 vars in 1018 bytes} [Tue May 10 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:36.301805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5ceff-026a-4366-a4d3-0c0867bc636f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:36.312808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5ceff-026a-4366-a4d3-0c0867bc636f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:36.316443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:36.317168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.317563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.317837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.328363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:36.329911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:36.340798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1163/2322] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:36.401988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:36.403481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:36.475591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f1bb6-2222-40c0-8f95-e509d411e56f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:36.480850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f7007-c2ef-4add-81ce-6ac42315bdb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:36.481507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f7007-c2ef-4add-81ce-6ac42315bdb6 service placement] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.481848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f7007-c2ef-4add-81ce-6ac42315bdb6 service placement] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.482107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f7007-c2ef-4add-81ce-6ac42315bdb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.484125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-282f7007-c2ef-4add-81ce-6ac42315bdb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:36.496727 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f7007-c2ef-4add-81ce-6ac42315bdb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:36.498310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f7007-c2ef-4add-81ce-6ac42315bdb6 service placement] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:36.508191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1160/2323] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:36.549186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:36.612523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c1d3e-1a09-44ea-baee-76dd835112f4 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:36.617261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:36.618134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.618412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.618681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] PATH_INFO: `/v3/users/05eb45280be84a17a4818333c99e7efe` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.620238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05eb45280be84a17a4818333c99e7efe)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:36.622167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:36.671553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05eb45280be84a17a4818333c99e7efe'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:36.672290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05eb45280be84a17a4818333c99e7efe'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:36.684618 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05eb45280be84a17a4818333c99e7efe'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:36.695842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05eb45280be84a17a4818333c99e7efe'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:36.703303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05eb45280be84a17a4818333c99e7efe'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:36.709195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1164/2324] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:03:36 2022] DELETE /identity/v3/users/05eb45280be84a17a4818333c99e7efe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:36.713748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.714043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.714325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.731834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:36.733002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:36.802631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1161/2325] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:36.812637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:36.814050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:36.877901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279822-d3e9-4598-8b43-6f94f92439a5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:36.882759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:36.883420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:36.883745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:36.884049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:36.895136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:36.896921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:36.907251 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1165/2326] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:37.175274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:37.176845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:37.190557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327d4b-bfeb-4bfd-9743-e6ba55f9b0f0 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:37.195457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:37.196397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:37.196781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:37.197122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] PATH_INFO: `/v3/projects/1c0c5b7666ac4429b8cb6ffd1154b797` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:37.198320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0c5b7666ac4429b8cb6ffd1154b797)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:37.201202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:37.248895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0c5b7666ac4429b8cb6ffd1154b797', 'request_id': 'req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.256643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0c5b7666ac4429b8cb6ffd1154b797', 'request_id': 'req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.262824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0c5b7666ac4429b8cb6ffd1154b797', 'request_id': 'req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.272944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] The token cache is being invalidate because project 1c0c5b7666ac4429b8cb6ffd1154b797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:03:37.273225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.273910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.275486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1162/2327] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:03:37 2022] DELETE /identity/v3/projects/1c0c5b7666ac4429b8cb6ffd1154b797 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:37.279682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:37.289704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ee31-ebb9-48c1-98a0-931a64e4e4d1 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:37.347620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:37.349075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:37.349378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:37.349648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] PATH_INFO: `/v3/users/55b5fbdb3f3e4fbf8918ea42fccee816` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:37.351542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b5fbdb3f3e4fbf8918ea42fccee816)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:37.354508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:37.405867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b5fbdb3f3e4fbf8918ea42fccee816'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.406547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b5fbdb3f3e4fbf8918ea42fccee816'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.419498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b5fbdb3f3e4fbf8918ea42fccee816'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.432355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b5fbdb3f3e4fbf8918ea42fccee816'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.439364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0d2a4ae8-66ef-4cbd-8480-35f2ad72d479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b5fbdb3f3e4fbf8918ea42fccee816'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:37.445142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1166/2328] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:03:37 2022] DELETE /identity/v3/users/55b5fbdb3f3e4fbf8918ea42fccee816 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:37.864879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:37.866426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:37.893577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68efc-3caa-48f1-be60-f1a31d6ce3fc admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:37.951082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:37.951978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:37.952285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:37.952561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] PATH_INFO: `/v3/projects/6d6b438ac1e6464b9b8df79bd2c7825e` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:37.953812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6b438ac1e6464b9b8df79bd2c7825e)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:37.955984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.022193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6b438ac1e6464b9b8df79bd2c7825e', 'request_id': 'req-e52b82ef-0796-4055-b818-e3c80fa7ef9a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:38.031666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6b438ac1e6464b9b8df79bd2c7825e', 'request_id': 'req-e52b82ef-0796-4055-b818-e3c80fa7ef9a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:38.038216 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6b438ac1e6464b9b8df79bd2c7825e', 'request_id': 'req-e52b82ef-0796-4055-b818-e3c80fa7ef9a'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:38.048822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] The token cache is being invalidate because project 6d6b438ac1e6464b9b8df79bd2c7825e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:03:38.049108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:38.049751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e52b82ef-0796-4055-b818-e3c80fa7ef9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:38.051354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1163/2329] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:03:37 2022] DELETE /identity/v3/projects/6d6b438ac1e6464b9b8df79bd2c7825e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:38.056489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de6ea-e7f7-4ce2-aa26-be05db98237f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.057017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de6ea-e7f7-4ce2-aa26-be05db98237f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.057108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de6ea-e7f7-4ce2-aa26-be05db98237f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.075330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-017de6ea-e7f7-4ce2-aa26-be05db98237f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:38.076529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-017de6ea-e7f7-4ce2-aa26-be05db98237f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:38.151556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1167/2330] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:38.155277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bab90-ffa5-4eb7-b8eb-c0b3d0f97484 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.155655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bab90-ffa5-4eb7-b8eb-c0b3d0f97484 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.155998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bab90-ffa5-4eb7-b8eb-c0b3d0f97484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.176400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-947bab90-ffa5-4eb7-b8eb-c0b3d0f97484 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:38.177809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-947bab90-ffa5-4eb7-b8eb-c0b3d0f97484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:38.186248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1164/2331] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:38.190671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017de6ea-e7f7-4ce2-aa26-be05db98237f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.200470 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017de6ea-e7f7-4ce2-aa26-be05db98237f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.205282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.205942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.206231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.206511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.207242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:03:38.207553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.209271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.220434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1168/2332] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:03:38.224532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bab90-ffa5-4eb7-b8eb-c0b3d0f97484 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.233747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bab90-ffa5-4eb7-b8eb-c0b3d0f97484 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.238865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ee41a-b8d5-4d41-9879-a959635824e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.239567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ee41a-b8d5-4d41-9879-a959635824e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.239857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ee41a-b8d5-4d41-9879-a959635824e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.240155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ee41a-b8d5-4d41-9879-a959635824e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.240876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ee41a-b8d5-4d41-9879-a959635824e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.242829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ee41a-b8d5-4d41-9879-a959635824e6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.269874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1165/2333] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:03:38 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:38.274018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.284283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fedb0-c816-4928-9f14-1f4a263191d5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.341373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.342065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.342348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.342623 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.343325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.345265 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.351757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.352049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.352328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.371263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1169/2334] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:03:38 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:03:38.371722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:38.372510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.372967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:38.382291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1a262-11f9-46b4-af67-ec621c97de1d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.387048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.387697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.387981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.388254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.389056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.390641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.400455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1170/2335] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:03:38.405775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.415910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ea36-b61d-4bb2-96e0-8c29a63d655d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.421546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.422210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.422493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.422778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.423492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.425124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.431954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1166/2336] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:03:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:03:38.443873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1171/2337] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:03:38.445017 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.446618 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:38.447919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.458073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b9fd6-b632-4863-b3b2-1a4a61adb0d3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.464053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462692f-e40d-4b90-b522-8bf89616c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.465032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462692f-e40d-4b90-b522-8bf89616c7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.465307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462692f-e40d-4b90-b522-8bf89616c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.465596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462692f-e40d-4b90-b522-8bf89616c7cd admin admin] PATH_INFO: `/v3/projects/5e56c14b40f246d3a77698b41b3048bf/users/16f2fe7dc5e446ed90c27d04ca7ef01c/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.480621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462692f-e40d-4b90-b522-8bf89616c7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e56c14b40f246d3a77698b41b3048bf, user_id=16f2fe7dc5e446ed90c27d04ca7ef01c, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.483316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462692f-e40d-4b90-b522-8bf89616c7cd admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.497353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1172/2338] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:38 2022] PUT /identity/v3/projects/5e56c14b40f246d3a77698b41b3048bf/users/16f2fe7dc5e446ed90c27d04ca7ef01c/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:38.508491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.508811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.509089 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.520756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d52c3-6f2c-4bdf-8f79-c0d406c7e80f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.535289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] MFA Rules not processed for user `16f2fe7dc5e446ed90c27d04ca7ef01c`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:38.536877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:38.580228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.580845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.581126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.581408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.606042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1173/2339] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:03:38.616723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:38.619164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:38.640542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.642169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.650244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1167/2340] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:03:38.675645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f95c99-c4b1-4764-9277-c5d6723c7c41 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:38.679899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5b6b8-e64d-4626-8056-ceedf70e8335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:38.680564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b6b8-e64d-4626-8056-ceedf70e8335 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:38.680969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b6b8-e64d-4626-8056-ceedf70e8335 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:38.681188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b6b8-e64d-4626-8056-ceedf70e8335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:38.690196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5b6b8-e64d-4626-8056-ceedf70e8335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:38.691711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5b6b8-e64d-4626-8056-ceedf70e8335 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:38.702215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1174/2341] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:03:47.262709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:47.333574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a3137-e9e6-4798-aa49-0311f9a9ace9 service swift] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:47.339476 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:47.340599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:47.341096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:47.341376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] PATH_INFO: `/v3/users/16f2fe7dc5e446ed90c27d04ca7ef01c` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:47.342636 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f2fe7dc5e446ed90c27d04ca7ef01c)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:47.344600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:47.395641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f2fe7dc5e446ed90c27d04ca7ef01c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:47.396663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f2fe7dc5e446ed90c27d04ca7ef01c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:47.406708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f2fe7dc5e446ed90c27d04ca7ef01c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:47.420731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f2fe7dc5e446ed90c27d04ca7ef01c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:47.428561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f2fe7dc5e446ed90c27d04ca7ef01c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:47.441800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1168/2342] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:03:47 2022] DELETE /identity/v3/users/16f2fe7dc5e446ed90c27d04ca7ef01c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:47.443914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:47.444433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:47.444525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:47.468129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:47.469846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:47.561100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1175/2343] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:03:47.570510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:47.572241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:47.630994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b66d-55c7-4ccb-ae52-d0deab3f35e3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:47.634694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649b44a-461a-4696-abce-b2e72568433e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:47.635362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649b44a-461a-4696-abce-b2e72568433e service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:47.635645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649b44a-461a-4696-abce-b2e72568433e service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:47.635943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649b44a-461a-4696-abce-b2e72568433e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:47.646620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649b44a-461a-4696-abce-b2e72568433e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:47.648139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649b44a-461a-4696-abce-b2e72568433e service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:47.660353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1169/2344] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:47.971194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:47.973520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:48.006510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001481a-76f5-4e81-ae04-ed8e6b0275e7 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.013873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.014985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.015259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.015531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] PATH_INFO: `/v3/projects/5e56c14b40f246d3a77698b41b3048bf` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.016818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e56c14b40f246d3a77698b41b3048bf)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.018757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.076229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e56c14b40f246d3a77698b41b3048bf', 'request_id': 'req-ffc88076-aff8-47c5-a91d-3e6bf10a5981'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:48.084181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e56c14b40f246d3a77698b41b3048bf', 'request_id': 'req-ffc88076-aff8-47c5-a91d-3e6bf10a5981'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:48.091737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e56c14b40f246d3a77698b41b3048bf', 'request_id': 'req-ffc88076-aff8-47c5-a91d-3e6bf10a5981'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:48.102752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] The token cache is being invalidate because project 5e56c14b40f246d3a77698b41b3048bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:03:48.103042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:48.103736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffc88076-aff8-47c5-a91d-3e6bf10a5981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:03:48.105370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1176/2345] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:03:47 2022] DELETE /identity/v3/projects/5e56c14b40f246d3a77698b41b3048bf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:48.110284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb20e4-2527-4eeb-82ee-cf7f70f21430 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.110621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb20e4-2527-4eeb-82ee-cf7f70f21430 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.110902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb20e4-2527-4eeb-82ee-cf7f70f21430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.129437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-dceb20e4-2527-4eeb-82ee-cf7f70f21430 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:48.130783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-dceb20e4-2527-4eeb-82ee-cf7f70f21430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:48.192038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1170/2346] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:03:48.199741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6a89-5d32-44c1-98bf-56bd6e5d4aa1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.200029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6a89-5d32-44c1-98bf-56bd6e5d4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.200307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6a89-5d32-44c1-98bf-56bd6e5d4aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.219101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-dd1b6a89-5d32-44c1-98bf-56bd6e5d4aa1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:48.220320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-dd1b6a89-5d32-44c1-98bf-56bd6e5d4aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:48.228696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1177/2347] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:48.232913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb20e4-2527-4eeb-82ee-cf7f70f21430 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:48.242592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb20e4-2527-4eeb-82ee-cf7f70f21430 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.247438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.248088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.248369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.248641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.249400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:03:48.249707 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.251302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.265235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1171/2348] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:03:48.267682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6a89-5d32-44c1-98bf-56bd6e5d4aa1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:48.287218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6a89-5d32-44c1-98bf-56bd6e5d4aa1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.293103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.294097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.294498 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.294882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.295934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.298696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.329783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1178/2349] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:03:48 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:48.333282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:48.343118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35aa32-0dc9-4ad1-9727-966f9a6b16df admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.401067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.401676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.402163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.402570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.403440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.405415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.428853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1172/2350] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:03:48 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:03:48.433125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:48.443421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a62bf-8b09-46d4-b125-7ec15bc2b594 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.448411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.449144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.449412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.449687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.450437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.452218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.463591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1179/2351] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:03:48.467696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:48.477927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4637976-91d7-46bf-9c5e-8b32046fe5d5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.483162 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd370dc5-4563-451f-a701-e6efc3d647b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.483819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370dc5-4563-451f-a701-e6efc3d647b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.484097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370dc5-4563-451f-a701-e6efc3d647b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.484374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370dc5-4563-451f-a701-e6efc3d647b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.485151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd370dc5-4563-451f-a701-e6efc3d647b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.486755 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd370dc5-4563-451f-a701-e6efc3d647b8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.497306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1173/2352] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:03:48.501547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:48.511789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b96335-fe71-4662-a999-7ec2550e1fcc admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.517364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.518254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.518534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.518810 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] PATH_INFO: `/v3/projects/277228b99e704991b8badf3892c02b1c/users/27c8b37c389a4c43a79b872e4eb1628f/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.534999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277228b99e704991b8badf3892c02b1c, user_id=27c8b37c389a4c43a79b872e4eb1628f, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.537940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.553289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1180/2353] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:03:48 2022] PUT /identity/v3/projects/277228b99e704991b8badf3892c02b1c/users/27c8b37c389a4c43a79b872e4eb1628f/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:03:48.564951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.565237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.565508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.595307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] MFA Rules not processed for user `27c8b37c389a4c43a79b872e4eb1628f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:48.597053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:48.667027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1174/2354] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:03:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:03:48.679255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:48.681547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:48.738154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983ad0-ec53-455c-b2d8-f8f214f0cc64 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:48.742103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:48.742751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:48.743031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:48.743312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:48.752503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:48.754000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:48.763271 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1181/2355] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:49.264901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:49.266749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:49.349685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac60f-b6e1-41a6-886e-28505007dbda None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:49.356582 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3a224-d6a5-44ac-907f-7410dbd07386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:49.357299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a224-d6a5-44ac-907f-7410dbd07386 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:49.357587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a224-d6a5-44ac-907f-7410dbd07386 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:49.357865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a224-d6a5-44ac-907f-7410dbd07386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:49.359812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-50d3a224-d6a5-44ac-907f-7410dbd07386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:49.421305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3a224-d6a5-44ac-907f-7410dbd07386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:49.423251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3a224-d6a5-44ac-907f-7410dbd07386 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:49.432903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1175/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:54.087554 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:54.102931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb894ad-6ca9-4651-acc3-6c2f9ab9981b service glance] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:54.114338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:54.115088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:54.115425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:54.115775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:54.118011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:54.132509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:54.134279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:54.150440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1182/2357] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:03:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:03:56.218853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d138-fa60-4c54-b302-9008e0e32bd4 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:56.219440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d138-fa60-4c54-b302-9008e0e32bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:56.219440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d138-fa60-4c54-b302-9008e0e32bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:56.236883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a200d138-fa60-4c54-b302-9008e0e32bd4 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:03:56.238075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a200d138-fa60-4c54-b302-9008e0e32bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:56.295405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1176/2358] 10.222.0.52 () {58 vars in 967 bytes} [Tue May 10 19:03:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:03:56.310203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:03:56.311670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:03:56.383082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c50f8-86ab-43fe-a41c-96db05cc7316 service nova] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:03:56.389229 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:03:56.389874 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:03:56.390156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:03:56.390442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:03:56.400277 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:03:56.401914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:03:56.410514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1183/2359] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:03:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:04:06.708560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200d138-fa60-4c54-b302-9008e0e32bd4 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:06.722568 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200d138-fa60-4c54-b302-9008e0e32bd4 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:06.729903 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2986003-fe07-40a6-99ba-708908241b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:06.730647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986003-fe07-40a6-99ba-708908241b12 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:06.730836 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986003-fe07-40a6-99ba-708908241b12 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:06.731056 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986003-fe07-40a6-99ba-708908241b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:06.733311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a2986003-fe07-40a6-99ba-708908241b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:06.794018 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2986003-fe07-40a6-99ba-708908241b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:06.795738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2986003-fe07-40a6-99ba-708908241b12 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:06.804634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1177/2360] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:21.087620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:21.153555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bfa6-f0f3-45e4-bc53-a1bde097e948 service swift] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:21.158488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:21.159357 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:21.159598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:21.159904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] PATH_INFO: `/v3/users/27c8b37c389a4c43a79b872e4eb1628f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:21.161172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c8b37c389a4c43a79b872e4eb1628f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:21.163106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:21.213558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c8b37c389a4c43a79b872e4eb1628f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.214260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c8b37c389a4c43a79b872e4eb1628f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.225644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c8b37c389a4c43a79b872e4eb1628f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.232981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c8b37c389a4c43a79b872e4eb1628f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.240364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c8b37c389a4c43a79b872e4eb1628f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.246748 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1184/2361] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:21 2022] DELETE /identity/v3/users/27c8b37c389a4c43a79b872e4eb1628f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:21.251341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:21.251857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:21.251857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:21.269244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:21.270439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:21.333463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1178/2362] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:21.343473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:21.345206 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:21.404287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145673b4-54c9-4bc8-880e-7f67103b9ed5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:21.409182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab3aed-15fa-4378-a6de-48f633c13b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:21.409826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3aed-15fa-4378-a6de-48f633c13b75 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:21.410105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3aed-15fa-4378-a6de-48f633c13b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:21.410374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3aed-15fa-4378-a6de-48f633c13b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:21.419997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab3aed-15fa-4378-a6de-48f633c13b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:21.421467 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab3aed-15fa-4378-a6de-48f633c13b75 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:21.431044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1185/2363] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:21.699080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:21.700913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:21.717451 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfff53-0822-4c96-bfdd-7e4e0a44e631 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:21.724034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:21.725073 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:21.725401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:21.725722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] PATH_INFO: `/v3/projects/277228b99e704991b8badf3892c02b1c` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:21.727048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277228b99e704991b8badf3892c02b1c)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:21.729106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:21.777024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277228b99e704991b8badf3892c02b1c', 'request_id': 'req-1faf6e29-7445-4692-a593-56da95609062'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.785790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277228b99e704991b8badf3892c02b1c', 'request_id': 'req-1faf6e29-7445-4692-a593-56da95609062'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.792193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277228b99e704991b8badf3892c02b1c', 'request_id': 'req-1faf6e29-7445-4692-a593-56da95609062'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.802428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] The token cache is being invalidate because project 277228b99e704991b8badf3892c02b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:21.802712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.803386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1faf6e29-7445-4692-a593-56da95609062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:21.805028 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1179/2364] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:21 2022] DELETE /identity/v3/projects/277228b99e704991b8badf3892c02b1c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:21.809942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c15cb7-f240-49cd-8ca2-e0050035de57 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:21.810227 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c15cb7-f240-49cd-8ca2-e0050035de57 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:21.810497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c15cb7-f240-49cd-8ca2-e0050035de57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:21.829525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b1c15cb7-f240-49cd-8ca2-e0050035de57 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:21.830719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b1c15cb7-f240-49cd-8ca2-e0050035de57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:21.897283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1186/2365] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:21.906192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e555-2c28-4e7e-afa2-25f7f41194a8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:21.906543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e555-2c28-4e7e-afa2-25f7f41194a8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:21.906893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e555-2c28-4e7e-afa2-25f7f41194a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:21.928055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-21a3e555-2c28-4e7e-afa2-25f7f41194a8 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:21.929314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-21a3e555-2c28-4e7e-afa2-25f7f41194a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:21.938639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1180/2366] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:21.943372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c15cb7-f240-49cd-8ca2-e0050035de57 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:21.958546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c15cb7-f240-49cd-8ca2-e0050035de57 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:21.968025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:21.969067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:21.969456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:21.969817 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:21.971002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:21.971396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:21.973436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:21.987347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1187/2367] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:21.992122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e555-2c28-4e7e-afa2-25f7f41194a8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:22.002145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e555-2c28-4e7e-afa2-25f7f41194a8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:22.009280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:22.009967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:22.010221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:22.010497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:22.011199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:22.013589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:22.054744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1181/2368] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:21 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:22.059582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:22.070468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bc7da-8f9b-43e4-9e39-ce89cb0275de admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:22.139314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:22.140007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:22.140263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:22.140534 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:22.141270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:22.143205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:22.163212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1188/2369] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:22 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:22.167462 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:22.178167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f5ac1-10e2-469b-9d02-e6c19614b7eb admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:22.184237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:22.185139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:22.185429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:22.185700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:22.186440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:22.188034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:22.201560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1182/2370] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:22.202820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:22.213385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f16a22-b67f-4269-9c21-3451948608c7 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:22.218540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530f3a8-f3a9-437b-b106-e040725de409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:22.219317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530f3a8-f3a9-437b-b106-e040725de409 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:22.219546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530f3a8-f3a9-437b-b106-e040725de409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:22.219787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530f3a8-f3a9-437b-b106-e040725de409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:22.220510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530f3a8-f3a9-437b-b106-e040725de409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:22.222214 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530f3a8-f3a9-437b-b106-e040725de409 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:22.232788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1189/2371] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:22.236702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:22.247309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1307c7-dcaf-49cb-b9a3-acd0faac1735 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:22.252015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:22.252933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:22.253213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:22.253485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] PATH_INFO: `/v3/projects/158ffa09a81c43409bf2767c74516f39/users/e0c430b1281f406ca43df22ace5c64b5/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:22.268660 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158ffa09a81c43409bf2767c74516f39, user_id=e0c430b1281f406ca43df22ace5c64b5, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:22.271456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:22.295041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1183/2372] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:22 2022] PUT /identity/v3/projects/158ffa09a81c43409bf2767c74516f39/users/e0c430b1281f406ca43df22ace5c64b5/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:22.296838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:22.297148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:22.297408 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:22.324400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] MFA Rules not processed for user `e0c430b1281f406ca43df22ace5c64b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:22.325684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:22.388733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1190/2373] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:22.399488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:22.401232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:22.464415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86a4a-b9be-4864-a843-8f8029ab1215 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:22.468601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62d3f9-192c-4cd8-a1c9-e382df6179d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:22.469999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d3f9-192c-4cd8-a1c9-e382df6179d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:22.470287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d3f9-192c-4cd8-a1c9-e382df6179d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:22.470587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d3f9-192c-4cd8-a1c9-e382df6179d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:22.480161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62d3f9-192c-4cd8-a1c9-e382df6179d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:22.481632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62d3f9-192c-4cd8-a1c9-e382df6179d7 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:22.490929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1184/2374] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:22.949980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:22.951488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:23.042514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce89b-7c37-4996-89d7-2ff84cd4fb5b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:23.048845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:23.049614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:23.049970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:23.050315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:23.052305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:23.074854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:23.077876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:23.090704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1191/2375] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:23.854110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:23.854651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:23.854651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:23.872469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] MFA Rules not processed for user `e0c430b1281f406ca43df22ace5c64b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:23.873708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:23.881139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1185/2376] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:29.895292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:29.896858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:29.952268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe005e-95fb-4832-a99a-668c1f5aabe7 service nova] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:29.956256 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:29.956919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:29.957268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:29.957533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:29.959719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:30.023624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:30.025142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:30.034851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1192/2377] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:32.284301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:32.285894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:32.300244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd725-9790-4dde-83e2-a189be3bac4d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:32.305321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:32.306331 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:32.306735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:32.307110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:32.309513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:32.322313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:32.323879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:32.334807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1186/2378] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:33.685113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:33.686679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:33.699004 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f2a3-0413-4b01-8e18-31c46464dce1 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:33.709596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:33.711301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:33.711751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:33.711942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] PATH_INFO: `/v3/users/a1ccfbe59f4841a093c71c75585fb2ba` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:33.713298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ccfbe59f4841a093c71c75585fb2ba)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:33.715467 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:33.768036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ccfbe59f4841a093c71c75585fb2ba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:33.768551 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ccfbe59f4841a093c71c75585fb2ba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:33.779918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ccfbe59f4841a093c71c75585fb2ba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:33.787419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ccfbe59f4841a093c71c75585fb2ba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:33.796289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-0ee002ed-ce9e-4a80-8b5d-51e5a4a84c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ccfbe59f4841a093c71c75585fb2ba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:33.802779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1193/2379] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:33 2022] DELETE /identity/v3/users/a1ccfbe59f4841a093c71c75585fb2ba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:33.995344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.008238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7be8-8662-4a98-bf06-90b060dd1d56 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.074750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.075744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.076032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.076519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] PATH_INFO: `/v3/projects/f211dbe09fc34141b9d519a6e69c8dc2` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.077763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f211dbe09fc34141b9d519a6e69c8dc2)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.079652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.133367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f211dbe09fc34141b9d519a6e69c8dc2', 'request_id': 'req-1371cdca-6a53-4238-b8c9-aa6b94690ac5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:34.144521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f211dbe09fc34141b9d519a6e69c8dc2', 'request_id': 'req-1371cdca-6a53-4238-b8c9-aa6b94690ac5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:34.152161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f211dbe09fc34141b9d519a6e69c8dc2', 'request_id': 'req-1371cdca-6a53-4238-b8c9-aa6b94690ac5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:34.163425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] The token cache is being invalidate because project f211dbe09fc34141b9d519a6e69c8dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:34.163812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:34.164623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1371cdca-6a53-4238-b8c9-aa6b94690ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:34.169561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1187/2380] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:33 2022] DELETE /identity/v3/projects/f211dbe09fc34141b9d519a6e69c8dc2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:34.171355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9771ae-5fa7-4887-bdca-5f80eac1e234 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.171653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9771ae-5fa7-4887-bdca-5f80eac1e234 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.171936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9771ae-5fa7-4887-bdca-5f80eac1e234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.193598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ac9771ae-5fa7-4887-bdca-5f80eac1e234 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:34.195056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ac9771ae-5fa7-4887-bdca-5f80eac1e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:34.264642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1194/2381] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:34.266278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1e28-fd90-4778-ba68-5afb6b8d45b5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.266676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1e28-fd90-4778-ba68-5afb6b8d45b5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.267058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1e28-fd90-4778-ba68-5afb6b8d45b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.288222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b7ca1e28-fd90-4778-ba68-5afb6b8d45b5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:34.290374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b7ca1e28-fd90-4778-ba68-5afb6b8d45b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:34.304179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1188/2382] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:34.308958 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9771ae-5fa7-4887-bdca-5f80eac1e234 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.323305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9771ae-5fa7-4887-bdca-5f80eac1e234 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.329070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.330016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.330485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.332079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.332954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:34.333796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.335945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.353382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1195/2383] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:34.354682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1e28-fd90-4778-ba68-5afb6b8d45b5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.364641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1e28-fd90-4778-ba68-5afb6b8d45b5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.373656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.374399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.374875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.375325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.376031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.377981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.416576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1189/2384] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:34 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:34.418283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.429959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa3be-2d97-4d23-994a-0cbb625ecc89 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.497934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.498651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.498937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.499236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.500366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.502555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.530846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1196/2385] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:34 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:34.532354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.544016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1351-314b-42b6-b9e4-38efc253d989 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.548932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.549751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.550040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.550318 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.551147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.552864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.563993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1190/2386] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:34.568250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.578924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b937d5-62f8-4688-be52-c4355297621c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.584488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d31501-4e57-4b41-aa7a-1b3c4a7250ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.585215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31501-4e57-4b41-aa7a-1b3c4a7250ad admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.585496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31501-4e57-4b41-aa7a-1b3c4a7250ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.585764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31501-4e57-4b41-aa7a-1b3c4a7250ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.586507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d31501-4e57-4b41-aa7a-1b3c4a7250ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.588127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d31501-4e57-4b41-aa7a-1b3c4a7250ad admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.599447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1197/2387] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:34.603748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.614622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a59-ae20-4e84-9e46-42110b9a5445 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.620800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.621696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.621975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.622256 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] PATH_INFO: `/v3/projects/8363401bebd442cd884b68f6aa9562b2/users/c2afef94d1a74c1bb779060e99575fe6/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.637922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8363401bebd442cd884b68f6aa9562b2, user_id=c2afef94d1a74c1bb779060e99575fe6, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.640546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.655446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1191/2388] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:34 2022] PUT /identity/v3/projects/8363401bebd442cd884b68f6aa9562b2/users/c2afef94d1a74c1bb779060e99575fe6/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:34.666697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056009d-ebf5-4b22-a6d5-481d0080ab95 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.666945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056009d-ebf5-4b22-a6d5-481d0080ab95 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.667246 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056009d-ebf5-4b22-a6d5-481d0080ab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.696033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-1056009d-ebf5-4b22-a6d5-481d0080ab95 None None] MFA Rules not processed for user `c2afef94d1a74c1bb779060e99575fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:34.697290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1056009d-ebf5-4b22-a6d5-481d0080ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:34.768907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1198/2389] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:34.779970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:34.781865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:34.867129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bfc0f-f0ad-4898-81ac-b17099923998 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:34.873969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81864873-da65-4a55-81a0-12720bd50654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:34.874374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864873-da65-4a55-81a0-12720bd50654 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:34.874655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864873-da65-4a55-81a0-12720bd50654 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:34.874932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864873-da65-4a55-81a0-12720bd50654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:34.883368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81864873-da65-4a55-81a0-12720bd50654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:34.885029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81864873-da65-4a55-81a0-12720bd50654 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:34.895094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1192/2390] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:35.125078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056009d-ebf5-4b22-a6d5-481d0080ab95 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:35.196017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056009d-ebf5-4b22-a6d5-481d0080ab95 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:35.201209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:35.202212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:35.202563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:35.202906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] PATH_INFO: `/v3/users/c2afef94d1a74c1bb779060e99575fe6` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:35.204217 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2afef94d1a74c1bb779060e99575fe6)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:35.206289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:35.269870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2afef94d1a74c1bb779060e99575fe6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:35.270662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2afef94d1a74c1bb779060e99575fe6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:35.285569 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2afef94d1a74c1bb779060e99575fe6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:35.297171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2afef94d1a74c1bb779060e99575fe6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:35.307540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2afef94d1a74c1bb779060e99575fe6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:35.314966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1199/2391] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:35 2022] DELETE /identity/v3/users/c2afef94d1a74c1bb779060e99575fe6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:35.319706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:35.320229 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:35.320333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:35.343588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:35.344993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:35.438048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1193/2392] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:35.448018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:35.449961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:35.509778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80498-18b1-4eea-bd47-1cceb641542d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:35.514167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fdcc1-eff0-40aa-b9ce-f745dca64f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:35.514824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fdcc1-eff0-40aa-b9ce-f745dca64f96 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:35.515111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fdcc1-eff0-40aa-b9ce-f745dca64f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:35.515386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fdcc1-eff0-40aa-b9ce-f745dca64f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:35.530264 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fdcc1-eff0-40aa-b9ce-f745dca64f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:35.531906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fdcc1-eff0-40aa-b9ce-f745dca64f96 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:35.543724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1200/2393] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:35.953488 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:35.955358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:35.977544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7a2d-a597-44dd-a823-e3112ee5ed1b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:35.986364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:35.987348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:35.987697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:35.988088 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] PATH_INFO: `/v3/projects/8363401bebd442cd884b68f6aa9562b2` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:35.989542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8363401bebd442cd884b68f6aa9562b2)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:35.991508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.042502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8363401bebd442cd884b68f6aa9562b2', 'request_id': 'req-4f08f175-9e43-4fec-90a1-6f26268823c1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.052373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8363401bebd442cd884b68f6aa9562b2', 'request_id': 'req-4f08f175-9e43-4fec-90a1-6f26268823c1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.059110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8363401bebd442cd884b68f6aa9562b2', 'request_id': 'req-4f08f175-9e43-4fec-90a1-6f26268823c1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.069468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] The token cache is being invalidate because project 8363401bebd442cd884b68f6aa9562b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:36.069763 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.070425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4f08f175-9e43-4fec-90a1-6f26268823c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.072479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1194/2394] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:35 2022] DELETE /identity/v3/projects/8363401bebd442cd884b68f6aa9562b2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:36.077331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821603b-d511-4e9f-83a7-af9fe524bfda None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.077819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821603b-d511-4e9f-83a7-af9fe524bfda None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.077942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821603b-d511-4e9f-83a7-af9fe524bfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.096573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-6821603b-d511-4e9f-83a7-af9fe524bfda None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:36.097931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6821603b-d511-4e9f-83a7-af9fe524bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:36.163808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1201/2395] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:36.171583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1946c6-b773-4118-bcf8-ab0a4ae2495e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.171907 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1946c6-b773-4118-bcf8-ab0a4ae2495e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.172390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1946c6-b773-4118-bcf8-ab0a4ae2495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.191155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-fb1946c6-b773-4118-bcf8-ab0a4ae2495e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:36.192502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-fb1946c6-b773-4118-bcf8-ab0a4ae2495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:36.203340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1195/2396] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:36.211772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821603b-d511-4e9f-83a7-af9fe524bfda None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.225052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821603b-d511-4e9f-83a7-af9fe524bfda None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.229820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.230565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.230917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.231261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.232077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:36.232454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.234514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.247653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1202/2397] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:36.251966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1946c6-b773-4118-bcf8-ab0a4ae2495e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.262425 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1946c6-b773-4118-bcf8-ab0a4ae2495e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.269428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.270244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.270665 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.271045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.272356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.275715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.308469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1196/2398] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:36 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:36.313116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.328297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791345c-9c41-415c-80b0-7837c1f996aa admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.398804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.399481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.399760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.400033 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.400751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.402670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.425391 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1203/2399] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:36 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:36.429789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.446702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1e800-2eac-4753-aaaa-96159f971cce admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.456543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.457409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.457790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.458129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.459169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.461215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.478059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1197/2400] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:36.478392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.489540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48e364-a1bd-4856-812a-8362fe1a7862 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.495017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482c880-3058-4aa8-9bde-dba8b4ea1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.495830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c880-3058-4aa8-9bde-dba8b4ea1656 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.496179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c880-3058-4aa8-9bde-dba8b4ea1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.496525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c880-3058-4aa8-9bde-dba8b4ea1656 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.497367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482c880-3058-4aa8-9bde-dba8b4ea1656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.499037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482c880-3058-4aa8-9bde-dba8b4ea1656 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.510665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1204/2401] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:36.514990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.527104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dadc9b-e921-4a16-aef9-331424569b03 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.532652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.533813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.534364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.534655 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] PATH_INFO: `/v3/projects/f1ec9cf787f34be584e80d839de113f6/users/e5be8063559243c69b9295deb3bd712e/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.559546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ec9cf787f34be584e80d839de113f6, user_id=e5be8063559243c69b9295deb3bd712e, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.564346 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.593932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1198/2402] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:36 2022] PUT /identity/v3/projects/f1ec9cf787f34be584e80d839de113f6/users/e5be8063559243c69b9295deb3bd712e/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:36.595338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.595633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.595916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.625154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] MFA Rules not processed for user `e5be8063559243c69b9295deb3bd712e`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:36.626639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:36.706107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1205/2403] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:36.710840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.789804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de13ae-18d3-458d-a17e-9c464eec7b8c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.794976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.795740 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.796012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.796284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.797129 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.799396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.799530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.801157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:36.818299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44880f4-79e1-403f-8902-7ef2b19377d9 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.824491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.825422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.825705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.825978 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] PATH_INFO: `/v3/users/68b1c1f3865042b1bb208cc36b612c55` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.827209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b1c1f3865042b1bb208cc36b612c55)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.829297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.831882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1199/2404] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:36 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:36.838904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.885068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b1c1f3865042b1bb208cc36b612c55'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.885779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b1c1f3865042b1bb208cc36b612c55'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.910091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b1c1f3865042b1bb208cc36b612c55'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.920102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b1c1f3865042b1bb208cc36b612c55'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.921096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02804d-e855-48ad-8fca-021e471edfb8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:36.927302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:36.928021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:36.928306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:36.928585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:36.929144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b1c1f3865042b1bb208cc36b612c55'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:36.930650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:36.931248 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:36.936240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1206/2405] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:36 2022] DELETE /identity/v3/users/68b1c1f3865042b1bb208cc36b612c55 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:36.953584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1200/2406] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:36 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:36.957834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:36.959303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.025761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356feb-d159-458e-a728-b25c95e24532 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.030165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.030832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.031113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.031386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.032115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.033741 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.044476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1207/2407] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:37.048770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.058682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd92b-b9fe-4c80-848e-607e00f1effc admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.063586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.064591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.064947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.065285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] PATH_INFO: `/v3/projects/9da27090701144b189d2a490504bb30c/users/57a8b87101a64c0d8f2eaad02837a205/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.084014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da27090701144b189d2a490504bb30c, user_id=57a8b87101a64c0d8f2eaad02837a205, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.088708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.108372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1201/2408] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:37 2022] PUT /identity/v3/projects/9da27090701144b189d2a490504bb30c/users/57a8b87101a64c0d8f2eaad02837a205/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:37.112250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.131917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec2cb-13dd-4739-b6f2-24b63898f7e6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.181850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.182520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.182806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.183062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.183912 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.185543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.195652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1208/2409] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:37.200059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.218388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acde8-c8eb-40d1-8f7f-d96e28c01495 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.220190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.222073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.225184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf383-8f99-44ca-9869-ef1f4709411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.226269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf383-8f99-44ca-9869-ef1f4709411e admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.226492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf383-8f99-44ca-9869-ef1f4709411e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.226766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf383-8f99-44ca-9869-ef1f4709411e admin admin] PATH_INFO: `/v3/projects/9da27090701144b189d2a490504bb30c/users/57a8b87101a64c0d8f2eaad02837a205/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.228995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabf383-8f99-44ca-9869-ef1f4709411e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da27090701144b189d2a490504bb30c, user_id=57a8b87101a64c0d8f2eaad02837a205, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.231616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabf383-8f99-44ca-9869-ef1f4709411e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.235371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b7f9-1e0f-42b2-adfd-3225bc98e828 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.240936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.241844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.242102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.242377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] PATH_INFO: `/v3/projects/08319d2b6ebf4a40830d212321cb6b63` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.243886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08319d2b6ebf4a40830d212321cb6b63)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.245340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1202/2410] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:37 2022] PUT /identity/v3/projects/9da27090701144b189d2a490504bb30c/users/57a8b87101a64c0d8f2eaad02837a205/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:37.245931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.256928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.257234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.257554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.284489 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] MFA Rules not processed for user `57a8b87101a64c0d8f2eaad02837a205`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:37.285941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.292453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08319d2b6ebf4a40830d212321cb6b63', 'request_id': 'req-49eb01f1-bfdf-455f-82a2-557e5ada6912'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:37.299840 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08319d2b6ebf4a40830d212321cb6b63', 'request_id': 'req-49eb01f1-bfdf-455f-82a2-557e5ada6912'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:37.307393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08319d2b6ebf4a40830d212321cb6b63', 'request_id': 'req-49eb01f1-bfdf-455f-82a2-557e5ada6912'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:37.317131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] The token cache is being invalidate because project 08319d2b6ebf4a40830d212321cb6b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:37.317407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:37.318055 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-49eb01f1-bfdf-455f-82a2-557e5ada6912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:37.319820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1209/2411] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:37 2022] DELETE /identity/v3/projects/08319d2b6ebf4a40830d212321cb6b63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:37.324405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb8c1-1fcc-4159-a767-f66b04d1cb07 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.324638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb8c1-1fcc-4159-a767-f66b04d1cb07 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.324948 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb8c1-1fcc-4159-a767-f66b04d1cb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.342169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4ecfb8c1-1fcc-4159-a767-f66b04d1cb07 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:37.343359 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4ecfb8c1-1fcc-4159-a767-f66b04d1cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.354381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1203/2412] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:37.366286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.367988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.402564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1210/2413] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:37.414797 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99d83-16a0-402b-9c64-ea3f868ea603 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.415094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99d83-16a0-402b-9c64-ea3f868ea603 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.415399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99d83-16a0-402b-9c64-ea3f868ea603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.430801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae686de-7942-45d1-89fc-6d720a5edf5e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.434518 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-6ce99d83-16a0-402b-9c64-ea3f868ea603 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:37.434739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.435467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.435727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6ce99d83-16a0-402b-9c64-ea3f868ea603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.435845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.436022 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.443995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1211/2414] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:37.446325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.448722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99d83-16a0-402b-9c64-ea3f868ea603 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.448867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.461687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99d83-16a0-402b-9c64-ea3f868ea603 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.461851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1204/2415] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:37.467231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.468116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.468545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.468983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.469798 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:37.470312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.472041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.486054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1212/2416] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:37.490771 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.501993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565f778-042f-4da3-8716-65aa6d3c8705 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.507808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.508729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.509008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.512718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.512718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.512718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.513941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.517471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.530124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7f611-6894-498c-94f7-ea19c6b62e0b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.537891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.538584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.538870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.539195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.541207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.545466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1205/2417] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:37 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:37.549698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.604806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.606275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.615399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1213/2418] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:37.618865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6d21b-cbc4-44be-aade-ec4fd0341c33 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.624097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.624897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.625251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.625601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.626411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.628394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.650698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1206/2419] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:37 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:37.654940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.666404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd8254-0f9d-454a-b9fe-ba59dbb6529b service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.671020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.671685 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.671963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.672617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.672977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.674564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.688085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1214/2420] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:37.689509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.700828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c93d15-91be-40c2-bdf2-a12e188c5c0d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.709681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624118e-0b8e-4a29-a7c1-07c3845da2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.710366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624118e-0b8e-4a29-a7c1-07c3845da2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.710651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624118e-0b8e-4a29-a7c1-07c3845da2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.710933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624118e-0b8e-4a29-a7c1-07c3845da2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.711675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624118e-0b8e-4a29-a7c1-07c3845da2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.713311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624118e-0b8e-4a29-a7c1-07c3845da2ca admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.724605 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1207/2421] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:37.728563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.739705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f717-8d92-436f-a5b0-a1a6ac2c1122 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.745210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.746103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.746385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.746662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] PATH_INFO: `/v3/projects/02fe30119c754356a3e844692c890318/users/cedd910cd57c4c43a5133c58b41e8499/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.765868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fe30119c754356a3e844692c890318, user_id=cedd910cd57c4c43a5133c58b41e8499, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.768779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:37.784059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1215/2422] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:37 2022] PUT /identity/v3/projects/02fe30119c754356a3e844692c890318/users/cedd910cd57c4c43a5133c58b41e8499/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:37.794235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a2e2-aada-41da-a05e-78c04fd24d9d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.794688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a2e2-aada-41da-a05e-78c04fd24d9d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.795042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a2e2-aada-41da-a05e-78c04fd24d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.824605 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6df4a2e2-aada-41da-a05e-78c04fd24d9d None None] MFA Rules not processed for user `cedd910cd57c4c43a5133c58b41e8499`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:37.826065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6df4a2e2-aada-41da-a05e-78c04fd24d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:37.900399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1208/2423] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:37.901846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:37.964799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa95607-372c-4c07-a6d6-6beef9e41c3b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:37.970345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:37.971111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:37.971444 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:37.971906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:37.972884 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:37.975297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.002389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1216/2424] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:37 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:38.006597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4a2e2-aada-41da-a05e-78c04fd24d9d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.017675 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4a2e2-aada-41da-a05e-78c04fd24d9d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:38.073955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:38.074801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.075087 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.075363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.076066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:38.077990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.101673 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1209/2425] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:38 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:38.103897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.114806 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8451f-fd31-41ba-b3d5-59be3ce2349f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:38.120957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:38.121627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.121911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.122185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.122920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:38.124530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.135547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1217/2426] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:38.139682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.149765 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26816547-2164-4456-83f6-c24e5798e4e8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:38.155283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:38.156155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.156431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.156723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] PATH_INFO: `/v3/projects/a954cbb6cfbc4dc2b99c02279064827e/users/023a7f33747f4e40a63cf8ee7a05a061/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.172467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a954cbb6cfbc4dc2b99c02279064827e, user_id=023a7f33747f4e40a63cf8ee7a05a061, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:38.175156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.190358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1210/2427] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:38 2022] PUT /identity/v3/projects/a954cbb6cfbc4dc2b99c02279064827e/users/023a7f33747f4e40a63cf8ee7a05a061/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:38.194619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.204921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d66c1-c7bb-4d2a-8c49-d2f4e18b576d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:38.264164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a5358-84b0-455c-9d61-a10d8bf2a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:38.264890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a5358-84b0-455c-9d61-a10d8bf2a56e admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.265165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a5358-84b0-455c-9d61-a10d8bf2a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.265412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a5358-84b0-455c-9d61-a10d8bf2a56e admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.266135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a5358-84b0-455c-9d61-a10d8bf2a56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:38.267731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a5358-84b0-455c-9d61-a10d8bf2a56e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.280769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1218/2428] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:38.283201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.293945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670b65-0128-47cc-8d91-dd8fccb881a1 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:38.299456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:38.300351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.300814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.301098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] PATH_INFO: `/v3/projects/a954cbb6cfbc4dc2b99c02279064827e/users/023a7f33747f4e40a63cf8ee7a05a061/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.303197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a954cbb6cfbc4dc2b99c02279064827e, user_id=023a7f33747f4e40a63cf8ee7a05a061, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:38.305892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.316580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1211/2429] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:38 2022] PUT /identity/v3/projects/a954cbb6cfbc4dc2b99c02279064827e/users/023a7f33747f4e40a63cf8ee7a05a061/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:38.328994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aee3-0636-4e2f-947b-3bf3976a30c6 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.329519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aee3-0636-4e2f-947b-3bf3976a30c6 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.329998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aee3-0636-4e2f-947b-3bf3976a30c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.364258 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c919aee3-0636-4e2f-947b-3bf3976a30c6 None None] MFA Rules not processed for user `023a7f33747f4e40a63cf8ee7a05a061`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:38.365520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c919aee3-0636-4e2f-947b-3bf3976a30c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:38.452326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1219/2430] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:38.463652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.518587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d003-cc5c-4e26-905a-bfd7621dbce2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:38.522561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340f9d-c981-44e1-b4fe-322c52666a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:38.523211 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340f9d-c981-44e1-b4fe-322c52666a17 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.523495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340f9d-c981-44e1-b4fe-322c52666a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.523773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340f9d-c981-44e1-b4fe-322c52666a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.533709 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c340f9d-c981-44e1-b4fe-322c52666a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:38.535276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c340f9d-c981-44e1-b4fe-322c52666a17 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.544878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1212/2431] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:38.693139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aee3-0636-4e2f-947b-3bf3976a30c6 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.757061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aee3-0636-4e2f-947b-3bf3976a30c6 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:38.762503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:38.763376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.763655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.763933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] PATH_INFO: `/v3/users/cedd910cd57c4c43a5133c58b41e8499` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.765209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedd910cd57c4c43a5133c58b41e8499)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:38.767117 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:38.816394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedd910cd57c4c43a5133c58b41e8499'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:38.817065 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedd910cd57c4c43a5133c58b41e8499'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:38.828066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedd910cd57c4c43a5133c58b41e8499'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:38.837875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedd910cd57c4c43a5133c58b41e8499'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:38.845430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedd910cd57c4c43a5133c58b41e8499'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:38.851528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1220/2432] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:38 2022] DELETE /identity/v3/users/cedd910cd57c4c43a5133c58b41e8499 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:38.856270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:38.856556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:38.856864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:38.874721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:38.875849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:38.946703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1213/2433] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:38.956559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:38.958202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:39.022020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb657-24f3-45af-a61c-d80fc93ffed7 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:39.027719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:39.028375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:39.028651 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:39.028967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:39.039401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:39.040881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:39.051237 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1221/2434] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:39.335561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:39.349627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:39.361851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a2a93-7136-4b6e-933f-9dda6b019727 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:39.366684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:39.367544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:39.367817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:39.368465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] PATH_INFO: `/v3/projects/02fe30119c754356a3e844692c890318` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:39.370089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fe30119c754356a3e844692c890318)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:39.372169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:39.437049 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fe30119c754356a3e844692c890318', 'request_id': 'req-15393854-51ea-49b7-802a-c2c283abeb32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.447539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fe30119c754356a3e844692c890318', 'request_id': 'req-15393854-51ea-49b7-802a-c2c283abeb32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.460946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fe30119c754356a3e844692c890318', 'request_id': 'req-15393854-51ea-49b7-802a-c2c283abeb32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.474167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] The token cache is being invalidate because project 02fe30119c754356a3e844692c890318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:39.474748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.475108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.476720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1214/2435] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:39 2022] DELETE /identity/v3/projects/02fe30119c754356a3e844692c890318 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:39.481692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:39.495558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4df8-11f8-45e5-9893-6ed9d1823f5c service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:39.563583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:39.564531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:39.564924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:39.565241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] PATH_INFO: `/v3/users/023a7f33747f4e40a63cf8ee7a05a061` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:39.566645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023a7f33747f4e40a63cf8ee7a05a061)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:39.568685 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:39.634974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023a7f33747f4e40a63cf8ee7a05a061'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.636115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023a7f33747f4e40a63cf8ee7a05a061'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.650422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023a7f33747f4e40a63cf8ee7a05a061'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.658977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023a7f33747f4e40a63cf8ee7a05a061'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.665730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c8a858ee-a9a1-4a06-88c8-aed23c6a0e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023a7f33747f4e40a63cf8ee7a05a061'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:39.671721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1222/2436] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:39 2022] DELETE /identity/v3/users/023a7f33747f4e40a63cf8ee7a05a061 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:40.061499 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.062927 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:40.078151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15393854-51ea-49b7-802a-c2c283abeb32 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:40.145498 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:40.146696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.147137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.147687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] PATH_INFO: `/v3/projects/a954cbb6cfbc4dc2b99c02279064827e` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.149160 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a954cbb6cfbc4dc2b99c02279064827e)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:40.151082 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:40.196915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a954cbb6cfbc4dc2b99c02279064827e', 'request_id': 'req-d127f70d-71e4-4aad-bf44-b09b74a4612f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:40.204801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a954cbb6cfbc4dc2b99c02279064827e', 'request_id': 'req-d127f70d-71e4-4aad-bf44-b09b74a4612f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:40.211098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a954cbb6cfbc4dc2b99c02279064827e', 'request_id': 'req-d127f70d-71e4-4aad-bf44-b09b74a4612f'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:40.221226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] The token cache is being invalidate because project a954cbb6cfbc4dc2b99c02279064827e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:40.221515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:40.222156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d127f70d-71e4-4aad-bf44-b09b74a4612f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:40.224130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1215/2437] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:40 2022] DELETE /identity/v3/projects/a954cbb6cfbc4dc2b99c02279064827e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:40.229121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dfc97-2b7b-487b-9d38-ff7f48b308cf None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.229441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dfc97-2b7b-487b-9d38-ff7f48b308cf None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.229720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dfc97-2b7b-487b-9d38-ff7f48b308cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.248431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8f8dfc97-2b7b-487b-9d38-ff7f48b308cf None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:40.249809 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8f8dfc97-2b7b-487b-9d38-ff7f48b308cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:40.312636 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1223/2438] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:40.320202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505256c7-ba3e-4afa-8d81-3e785da28ceb None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.320484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505256c7-ba3e-4afa-8d81-3e785da28ceb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.320817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505256c7-ba3e-4afa-8d81-3e785da28ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.338749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-505256c7-ba3e-4afa-8d81-3e785da28ceb None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:40.340231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-505256c7-ba3e-4afa-8d81-3e785da28ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:40.349247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1216/2439] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:40.353326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dfc97-2b7b-487b-9d38-ff7f48b308cf None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.363095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dfc97-2b7b-487b-9d38-ff7f48b308cf None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:40.368885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:40.369563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.369845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.370122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.371006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:40.371557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:40.373255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:40.385304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1224/2440] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:40.389916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505256c7-ba3e-4afa-8d81-3e785da28ceb None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.399446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505256c7-ba3e-4afa-8d81-3e785da28ceb None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:40.405035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:40.405781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.406062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.406336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.407043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:40.408963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:40.444599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1217/2441] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:40 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:40.445490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.459769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab417c-70d4-4231-8200-9981969c2da4 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:40.532113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:40.533141 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.533360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.533562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.534139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:40.537262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:40.573036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1225/2442] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:40 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:40.577940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.591989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618075a-c357-4f24-a00a-8b5529e74456 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:40.602431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:40.603794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.604429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.605413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.606630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:40.611885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:40.628396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1218/2443] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:40.632175 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.644641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee82f56-a90c-4f1d-9354-db03e4c9249d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:40.650580 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0046f-d754-4770-97e5-f0a8e18c9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:40.651598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0046f-d754-4770-97e5-f0a8e18c9b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.652072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0046f-d754-4770-97e5-f0a8e18c9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.652574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0046f-d754-4770-97e5-f0a8e18c9b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.653423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0046f-d754-4770-97e5-f0a8e18c9b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:40.655040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0046f-d754-4770-97e5-f0a8e18c9b92 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:40.668524 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1226/2444] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:40.672612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.689978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8e2b-08e0-4d16-9185-aeb23105539f admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:40.700062 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:40.701888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.702259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.702562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] PATH_INFO: `/v3/projects/0c6e7957cc974c248b0ebd5944013e3d/users/37f6c854fcbd4b96a5b7ee950d971f32/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.726698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6e7957cc974c248b0ebd5944013e3d, user_id=37f6c854fcbd4b96a5b7ee950d971f32, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:40.732514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:40.794379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1219/2445] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:40 2022] PUT /identity/v3/projects/0c6e7957cc974c248b0ebd5944013e3d/users/37f6c854fcbd4b96a5b7ee950d971f32/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:40.799555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:40.800578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:40.800915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:40.845892 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:40.847533 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:40.973093 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1227/2446] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:40.983343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:40.985518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:41.053117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0677f5-3bf1-4543-9bca-ad564f6a8948 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:41.057265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5b94-b832-4f15-abf6-cebc0f75e029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:41.057957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5b94-b832-4f15-abf6-cebc0f75e029 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:41.058298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5b94-b832-4f15-abf6-cebc0f75e029 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:41.058593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5b94-b832-4f15-abf6-cebc0f75e029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:41.069412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5b94-b832-4f15-abf6-cebc0f75e029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:41.070855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5b94-b832-4f15-abf6-cebc0f75e029 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:41.093623 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1220/2447] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:41.166453 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:41.168035 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:41.181317 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1783b-9724-4686-b767-32ecd8924574 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:41.187989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:41.188995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:41.189387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:41.189785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] PATH_INFO: `/v3/users/e5be8063559243c69b9295deb3bd712e` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:41.192348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5be8063559243c69b9295deb3bd712e)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:41.194722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:41.258185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5be8063559243c69b9295deb3bd712e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:41.259596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5be8063559243c69b9295deb3bd712e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:41.293853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5be8063559243c69b9295deb3bd712e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:41.304510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5be8063559243c69b9295deb3bd712e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:41.315450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5be8063559243c69b9295deb3bd712e'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:41.329014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1228/2448] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:41 2022] DELETE /identity/v3/users/e5be8063559243c69b9295deb3bd712e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:41.331098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae1aa-41e3-41bf-8014-89d485caf07a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:41.331750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae1aa-41e3-41bf-8014-89d485caf07a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:41.332316 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae1aa-41e3-41bf-8014-89d485caf07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:41.355607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-88eae1aa-41e3-41bf-8014-89d485caf07a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:41.369875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-88eae1aa-41e3-41bf-8014-89d485caf07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:41.510653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1221/2449] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:41.525894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:41.527422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:41.630868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8aa6-c370-4120-9786-56c1f709d9dc admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:41.643439 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa0dc9-4971-4516-bdae-18e08d701bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:41.644177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa0dc9-4971-4516-bdae-18e08d701bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:41.644468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa0dc9-4971-4516-bdae-18e08d701bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:41.644765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa0dc9-4971-4516-bdae-18e08d701bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:41.675149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa0dc9-4971-4516-bdae-18e08d701bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:41.676758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa0dc9-4971-4516-bdae-18e08d701bf0 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:41.694557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1229/2450] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:41.830812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:41.831360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:41.831360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:41.871920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:41.873164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:41.986309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1222/2451] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:04:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:42.024208 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.024566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.024938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.032238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.034334 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.069921 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] MFA Rules not processed for user `37f6c854fcbd4b96a5b7ee950d971f32`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:42.072603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.167604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ff04-6de4-46a2-be7f-72830b46c054 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.173268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.174170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.174641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.175130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.175680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1230/2452] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:42.176714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.177990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.187275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.188889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.198446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e6aa-9d0a-469a-bda8-27267ec065a0 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.203811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.204691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.204994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.205574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1223/2453] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:04:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:04:42.206693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.208184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.211329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] PATH_INFO: `/v3/projects/f1ec9cf787f34be584e80d839de113f6` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.212816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ec9cf787f34be584e80d839de113f6)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.214745 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.236868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f2df5-7b55-4bfa-b4ed-f9db146733b6 service swift] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.241747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.242414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.242694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.243312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.244940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.247493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.285401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1224/2454] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:42 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:42.290333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.316194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ec9cf787f34be584e80d839de113f6', 'request_id': 'req-92c39555-aaef-485f-a9b9-34e1d7f289a6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.335066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ec9cf787f34be584e80d839de113f6', 'request_id': 'req-92c39555-aaef-485f-a9b9-34e1d7f289a6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.344923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ec9cf787f34be584e80d839de113f6', 'request_id': 'req-92c39555-aaef-485f-a9b9-34e1d7f289a6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.358165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] The token cache is being invalidate because project f1ec9cf787f34be584e80d839de113f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:42.358523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.359303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.361329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1231/2455] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:42 2022] DELETE /identity/v3/projects/f1ec9cf787f34be584e80d839de113f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:42.365238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.366572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.366891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8777441-15bf-4b23-af01-66056c188bf8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.439594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.440224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.440513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.441188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.443043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.445348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.446155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39555-aaef-485f-a9b9-34e1d7f289a6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.457953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.459194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.459579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.459808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] PATH_INFO: `/v3/users/57a8b87101a64c0d8f2eaad02837a205` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.461450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a8b87101a64c0d8f2eaad02837a205)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.468634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.473749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1225/2456] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:42 2022] POST /identity/v3/users => generated 309 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:42.478390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.480019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.494629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340a53c-7428-40c7-96e7-fa925ba55c53 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.499865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.500550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.500998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.501290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.502081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.504142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.517858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1226/2457] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:42.523244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.534061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebe427-ab9f-4a3a-99f5-a2703471eb31 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.539126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.540077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.540366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.540647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] PATH_INFO: `/v3/projects/59af3ab43a234c19867ff9fd27e0a98e/users/2e1d23d0edb54461863f97a870ae0b20/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.541147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a8b87101a64c0d8f2eaad02837a205'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.542738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a8b87101a64c0d8f2eaad02837a205'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.559169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59af3ab43a234c19867ff9fd27e0a98e, user_id=2e1d23d0edb54461863f97a870ae0b20, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.560769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a8b87101a64c0d8f2eaad02837a205'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.561997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.574746 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a8b87101a64c0d8f2eaad02837a205'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.576724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1227/2458] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:42 2022] PUT /identity/v3/projects/59af3ab43a234c19867ff9fd27e0a98e/users/2e1d23d0edb54461863f97a870ae0b20/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:42.580819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.582773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.603805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a8b87101a64c0d8f2eaad02837a205'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:42.610320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1232/2459] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:42 2022] DELETE /identity/v3/users/57a8b87101a64c0d8f2eaad02837a205 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:42.669810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750de4ca-c7bd-4c70-ad54-4db4edd720e1 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.743463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88009d-dd36-44d6-9b79-e668a04c2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.744544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88009d-dd36-44d6-9b79-e668a04c2a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.745097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88009d-dd36-44d6-9b79-e668a04c2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.745487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88009d-dd36-44d6-9b79-e668a04c2a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.746366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88009d-dd36-44d6-9b79-e668a04c2a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.748723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88009d-dd36-44d6-9b79-e668a04c2a5a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.761104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1228/2460] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:42.766027 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.777860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f34d0-4294-42e8-b9c1-587a700c5c14 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:42.786178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:42.787194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.787637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.787984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] PATH_INFO: `/v3/projects/59af3ab43a234c19867ff9fd27e0a98e/users/2e1d23d0edb54461863f97a870ae0b20/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.790260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59af3ab43a234c19867ff9fd27e0a98e, user_id=2e1d23d0edb54461863f97a870ae0b20, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:42.793269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:42.811082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1233/2461] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:42 2022] PUT /identity/v3/projects/59af3ab43a234c19867ff9fd27e0a98e/users/2e1d23d0edb54461863f97a870ae0b20/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:42.896509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:42.897671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:42.898013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:42.920722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:42.922149 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:42.979380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:42.981544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.009455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1229/2462] 10.222.0.52 () {58 vars in 967 bytes} [Tue May 10 19:04:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:43.022514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.024116 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.068337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d834c5-3729-4662-8deb-ee3622d49893 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.075450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.076422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.076907 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.077005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] PATH_INFO: `/v3/projects/9da27090701144b189d2a490504bb30c` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.078242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da27090701144b189d2a490504bb30c)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.080313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.145516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da27090701144b189d2a490504bb30c', 'request_id': 'req-d347a8be-8490-432a-801c-87c7a7c9cf72'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:43.153250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31390d3-071e-4fee-ad7c-bab6c69e2402 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.157726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da27090701144b189d2a490504bb30c', 'request_id': 'req-d347a8be-8490-432a-801c-87c7a7c9cf72'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:43.169327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da27090701144b189d2a490504bb30c', 'request_id': 'req-d347a8be-8490-432a-801c-87c7a7c9cf72'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:43.185382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] The token cache is being invalidate because project 9da27090701144b189d2a490504bb30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:43.185671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:43.186528 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d347a8be-8490-432a-801c-87c7a7c9cf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:43.189493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1234/2463] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:42 2022] DELETE /identity/v3/projects/9da27090701144b189d2a490504bb30c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:43.195240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85c5e-0ebe-46fc-b1b2-0f5aa6129f8d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.195621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85c5e-0ebe-46fc-b1b2-0f5aa6129f8d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.195971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85c5e-0ebe-46fc-b1b2-0f5aa6129f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.221168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-07b85c5e-0ebe-46fc-b1b2-0f5aa6129f8d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:43.222682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-07b85c5e-0ebe-46fc-b1b2-0f5aa6129f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.237859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.238919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.239539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.239968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.242206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.296706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1235/2464] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:43.302207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78622ed5-282a-4cdd-a143-b6ee8dfbe05f None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.302585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78622ed5-282a-4cdd-a143-b6ee8dfbe05f None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.303064 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78622ed5-282a-4cdd-a143-b6ee8dfbe05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.327855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-78622ed5-282a-4cdd-a143-b6ee8dfbe05f None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:43.329204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.329693 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-78622ed5-282a-4cdd-a143-b6ee8dfbe05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.332052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.339832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1236/2465] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:43.342998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1230/2466] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:04:43.344118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78622ed5-282a-4cdd-a143-b6ee8dfbe05f None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.358458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78622ed5-282a-4cdd-a143-b6ee8dfbe05f None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.365337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.366315 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.366603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.366995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.367769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:43.368400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.370254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.391091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1237/2467] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:43.396024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.410032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b707bf-95a5-494d-8979-9615e0dae2f9 service swift] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.415284 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.416107 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.416514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.416991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.417801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.419841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.462333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1231/2468] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:43.467010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.484469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ca4b1-6137-4903-81bd-631ba85cc55e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.561734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7961a-76c7-4992-b20b-0be124f29e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.562626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7961a-76c7-4992-b20b-0be124f29e47 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.563091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7961a-76c7-4992-b20b-0be124f29e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.563583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7961a-76c7-4992-b20b-0be124f29e47 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.564468 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7961a-76c7-4992-b20b-0be124f29e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.566760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7961a-76c7-4992-b20b-0be124f29e47 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.589849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1238/2469] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:43.593879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.600964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.601481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.601765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.604827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d91c8-6d40-4ab9-bb0c-06c9efb19107 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.610418 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.611370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.611666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.611935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.613011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.614627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.621046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:43.622465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.628729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1232/2470] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:43.630698 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.641141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f62d-c263-4f7b-a0e9-8316444a1db0 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.646477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.647174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.647576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.647700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.648429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.650058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.661132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1233/2471] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:43.665303 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.675431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1fbc2-7d80-4a20-a940-9b77dd217542 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.680167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960f907-de10-440a-94aa-cbecae3c51f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.681081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960f907-de10-440a-94aa-cbecae3c51f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.681365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960f907-de10-440a-94aa-cbecae3c51f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.681639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960f907-de10-440a-94aa-cbecae3c51f2 admin admin] PATH_INFO: `/v3/projects/b4ddacf99b884bbf8891a3300a1f7d7d/users/020782788c1841b0b4c1bbae0309393f/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.687483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1239/2472] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:43.702285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.703781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.706974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960f907-de10-440a-94aa-cbecae3c51f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ddacf99b884bbf8891a3300a1f7d7d, user_id=020782788c1841b0b4c1bbae0309393f, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.710427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960f907-de10-440a-94aa-cbecae3c51f2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.736553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1234/2473] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:43 2022] PUT /identity/v3/projects/b4ddacf99b884bbf8891a3300a1f7d7d/users/020782788c1841b0b4c1bbae0309393f/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:43.738283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5f52e-3ce2-4b7b-a037-ef0ee5545247 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.738578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5f52e-3ce2-4b7b-a037-ef0ee5545247 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.738923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5f52e-3ce2-4b7b-a037-ef0ee5545247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.766843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-45b5f52e-3ce2-4b7b-a037-ef0ee5545247 None None] MFA Rules not processed for user `020782788c1841b0b4c1bbae0309393f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:43.768404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-45b5f52e-3ce2-4b7b-a037-ef0ee5545247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:43.779437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351b8a-105d-423b-81a9-e257a4fc4f74 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.839483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1235/2474] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:43.843989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5f52e-3ce2-4b7b-a037-ef0ee5545247 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:43.856022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6c88b-1e98-41ab-8e10-612a73aff259 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.856816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6c88b-1e98-41ab-8e10-612a73aff259 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.857107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6c88b-1e98-41ab-8e10-612a73aff259 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.857425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6c88b-1e98-41ab-8e10-612a73aff259 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.912643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5f52e-3ce2-4b7b-a037-ef0ee5545247 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:43.917811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:43.918781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.919273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.919386 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6c88b-1e98-41ab-8e10-612a73aff259 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.919876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.920830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:43.921039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6c88b-1e98-41ab-8e10-612a73aff259 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.923135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:43.932308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1240/2475] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:04:43.965466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32f2b-ef3f-477b-861f-0caab8b5f8cb None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:43.965893 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32f2b-ef3f-477b-861f-0caab8b5f8cb None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:43.966136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32f2b-ef3f-477b-861f-0caab8b5f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:43.999348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1236/2476] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:43.999572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.015332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-96e32f2b-ef3f-477b-861f-0caab8b5f8cb None None] MFA Rules not processed for user `2e1d23d0edb54461863f97a870ae0b20`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:44.016635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-96e32f2b-ef3f-477b-861f-0caab8b5f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:44.113735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa658-23da-4991-b2f6-cd3f73ce8352 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.120818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.122330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.122773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.123221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.123801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1241/2477] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:44.124381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.126804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.165849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1237/2478] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:43 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:44.169985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e32f2b-ef3f-477b-861f-0caab8b5f8cb None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.193718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e32f2b-ef3f-477b-861f-0caab8b5f8cb None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.203083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.203834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.204161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.204530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.205708 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.207281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.224073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1242/2479] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:44.228179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.238841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ceea2-246f-4cac-a149-cd88d4a7ef07 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.244005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3d6b6-e7b6-4922-95d3-091f3d7a30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.244950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3d6b6-e7b6-4922-95d3-091f3d7a30f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.245231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3d6b6-e7b6-4922-95d3-091f3d7a30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.245558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3d6b6-e7b6-4922-95d3-091f3d7a30f5 admin admin] PATH_INFO: `/v3/projects/e44bdac4693642f282df95405efeaa35/users/6e81c85f456f4366b0105c3cbc23e69f/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.267330 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3d6b6-e7b6-4922-95d3-091f3d7a30f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44bdac4693642f282df95405efeaa35, user_id=6e81c85f456f4366b0105c3cbc23e69f, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.270634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3d6b6-e7b6-4922-95d3-091f3d7a30f5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.286672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1238/2480] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:44 2022] PUT /identity/v3/projects/e44bdac4693642f282df95405efeaa35/users/6e81c85f456f4366b0105c3cbc23e69f/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:44.290485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.303624 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcb143-de29-4b09-ab3f-c4287824b707 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.375689 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.376593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.376980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.377260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.378210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.378576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fd7a-a701-4b35-87b9-6b04a0e5e62a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.378962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fd7a-a701-4b35-87b9-6b04a0e5e62a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.379338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fd7a-a701-4b35-87b9-6b04a0e5e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.379980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.396049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1243/2481] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:44.397294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.399414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c0c8fd7a-a701-4b35-87b9-6b04a0e5e62a None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:44.401080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c0c8fd7a-a701-4b35-87b9-6b04a0e5e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:44.408233 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318322e-9107-444a-b163-ac586b36b0bf admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.413543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1ece-aa9e-4153-b607-46d1fe187232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.417232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1ece-aa9e-4153-b607-46d1fe187232 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.417232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1ece-aa9e-4153-b607-46d1fe187232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.417232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1ece-aa9e-4153-b607-46d1fe187232 admin admin] PATH_INFO: `/v3/projects/e44bdac4693642f282df95405efeaa35/users/6e81c85f456f4366b0105c3cbc23e69f/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.417736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1ece-aa9e-4153-b607-46d1fe187232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44bdac4693642f282df95405efeaa35, user_id=6e81c85f456f4366b0105c3cbc23e69f, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.420241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1ece-aa9e-4153-b607-46d1fe187232 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.438564 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1244/2482] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:44 2022] PUT /identity/v3/projects/e44bdac4693642f282df95405efeaa35/users/6e81c85f456f4366b0105c3cbc23e69f/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:44.449001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.449421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.449795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.481180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1239/2483] 10.222.0.52 () {58 vars in 967 bytes} [Tue May 10 19:04:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:44.483842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] MFA Rules not processed for user `6e81c85f456f4366b0105c3cbc23e69f`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:44.485176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:44.494102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8fd7a-a701-4b35-87b9-6b04a0e5e62a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.559804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1245/2484] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:44.562456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8fd7a-a701-4b35-87b9-6b04a0e5e62a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.572272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.573648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:44.623389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a712865-9dec-468e-a956-3be14438ea8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.624125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a712865-9dec-468e-a956-3be14438ea8a service swift] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.625560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a712865-9dec-468e-a956-3be14438ea8a service swift] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.625916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a712865-9dec-468e-a956-3be14438ea8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.633189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965871a3-34ba-49d0-b6e7-32cff90c8080 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.637003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.637677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.637961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.638239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.648494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.651336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.660230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1246/2485] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:44.684188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a712865-9dec-468e-a956-3be14438ea8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.685923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a712865-9dec-468e-a956-3be14438ea8a service swift] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.701311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1240/2486] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 19:04:44.736294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:44.806046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151ae74-2d18-4ba6-aa52-2b0fe1846272 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:44.810818 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:44.811934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.812211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.812660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] PATH_INFO: `/v3/users/020782788c1841b0b4c1bbae0309393f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.813955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=020782788c1841b0b4c1bbae0309393f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:44.816036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:44.877165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020782788c1841b0b4c1bbae0309393f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:44.878067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020782788c1841b0b4c1bbae0309393f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:44.892252 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020782788c1841b0b4c1bbae0309393f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:44.902829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020782788c1841b0b4c1bbae0309393f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:44.913772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020782788c1841b0b4c1bbae0309393f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:44.923614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1247/2487] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:44 2022] DELETE /identity/v3/users/020782788c1841b0b4c1bbae0309393f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:44.928620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:44.929137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:44.929356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:44.948916 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:44.950137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:45.032663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1241/2488] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:45.043063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:45.044617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:45.102062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c28f1-2b14-431c-9149-67ed6f701cae admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:45.108144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:45.108960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:45.109334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:45.109710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:45.121163 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:45.123126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:45.134329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1248/2489] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:45.333974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:45.335383 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:45.350964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cb890-f817-495f-9c27-f7b1ee5cd079 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:45.357987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:45.359071 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:45.359506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:45.359991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] PATH_INFO: `/v3/users/37f6c854fcbd4b96a5b7ee950d971f32` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:45.361798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f6c854fcbd4b96a5b7ee950d971f32)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:45.364409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:45.435493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f6c854fcbd4b96a5b7ee950d971f32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.437008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f6c854fcbd4b96a5b7ee950d971f32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.453075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f6c854fcbd4b96a5b7ee950d971f32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.479621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f6c854fcbd4b96a5b7ee950d971f32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.488556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f6c854fcbd4b96a5b7ee950d971f32'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.495890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1242/2490] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:45 2022] DELETE /identity/v3/users/37f6c854fcbd4b96a5b7ee950d971f32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:45.505635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:45.507587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:45.544975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e640-5e5f-4969-b0f5-c5f7b369434c service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:45.629170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:45.630175 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:45.630527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:45.630875 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] PATH_INFO: `/v3/projects/b4ddacf99b884bbf8891a3300a1f7d7d` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:45.632365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ddacf99b884bbf8891a3300a1f7d7d)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:45.634474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:45.702731 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ddacf99b884bbf8891a3300a1f7d7d', 'request_id': 'req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.712665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ddacf99b884bbf8891a3300a1f7d7d', 'request_id': 'req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.722491 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ddacf99b884bbf8891a3300a1f7d7d', 'request_id': 'req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.723846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:45.725258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:45.735061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] The token cache is being invalidate because project b4ddacf99b884bbf8891a3300a1f7d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:45.735226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.735940 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.741778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1249/2491] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:45 2022] DELETE /identity/v3/projects/b4ddacf99b884bbf8891a3300a1f7d7d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:45.746088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:45.749975 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:45.758578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4cfc-6c80-4105-87c0-d4545b34c6a9 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:45.821072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4e7c-bc3c-4707-84ae-b8867c4e85ae admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:45.827124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:45.827308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:45.827419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:45.827512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:45.827624 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:45.827727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:45.827727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] PATH_INFO: `/v3/users/6e81c85f456f4366b0105c3cbc23e69f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:45.828078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] PATH_INFO: `/v3/projects/0c6e7957cc974c248b0ebd5944013e3d` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:45.828794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e81c85f456f4366b0105c3cbc23e69f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:45.829281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6e7957cc974c248b0ebd5944013e3d)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:45.830724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:45.831159 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:45.880988 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6e7957cc974c248b0ebd5944013e3d', 'request_id': 'req-c290ee31-d918-4dbd-af22-402f2f043f12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.881420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e81c85f456f4366b0105c3cbc23e69f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.882168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e81c85f456f4366b0105c3cbc23e69f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.888370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6e7957cc974c248b0ebd5944013e3d', 'request_id': 'req-c290ee31-d918-4dbd-af22-402f2f043f12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.893710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e81c85f456f4366b0105c3cbc23e69f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.894647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6e7957cc974c248b0ebd5944013e3d', 'request_id': 'req-c290ee31-d918-4dbd-af22-402f2f043f12'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.901633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e81c85f456f4366b0105c3cbc23e69f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.905355 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] The token cache is being invalidate because project 0c6e7957cc974c248b0ebd5944013e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:45.905645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.906401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.907939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1243/2492] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:45 2022] DELETE /identity/v3/projects/0c6e7957cc974c248b0ebd5944013e3d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:45.909089 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e81c85f456f4366b0105c3cbc23e69f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:45.911795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:45.913176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:45.915159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1250/2493] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:45 2022] DELETE /identity/v3/users/6e81c85f456f4366b0105c3cbc23e69f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:45.976712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290ee31-d918-4dbd-af22-402f2f043f12 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.036140 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.037122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.037406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.037688 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] PATH_INFO: `/v3/users/2e1d23d0edb54461863f97a870ae0b20` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.038904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1d23d0edb54461863f97a870ae0b20)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.040886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.089296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1d23d0edb54461863f97a870ae0b20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.089879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1d23d0edb54461863f97a870ae0b20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.097296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1d23d0edb54461863f97a870ae0b20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.112378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1d23d0edb54461863f97a870ae0b20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.120011 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1d23d0edb54461863f97a870ae0b20'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.125868 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1244/2494] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:45 2022] DELETE /identity/v3/users/2e1d23d0edb54461863f97a870ae0b20 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:46.186443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.187889 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.202225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57776a75-6ae2-4beb-bd73-f0b0479165b5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.259029 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.259910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.260193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.260483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] PATH_INFO: `/v3/projects/e44bdac4693642f282df95405efeaa35` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.261716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44bdac4693642f282df95405efeaa35)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.263653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.304684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.306231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.313961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44bdac4693642f282df95405efeaa35', 'request_id': 'req-4729c2ce-9a5a-4266-8d20-96ded591fdba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.320554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9c5d-bfc8-4203-bcbc-0ce34430a18e admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.322946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44bdac4693642f282df95405efeaa35', 'request_id': 'req-4729c2ce-9a5a-4266-8d20-96ded591fdba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.330484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44bdac4693642f282df95405efeaa35', 'request_id': 'req-4729c2ce-9a5a-4266-8d20-96ded591fdba'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.341712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] The token cache is being invalidate because project e44bdac4693642f282df95405efeaa35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:46.341941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.342590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4729c2ce-9a5a-4266-8d20-96ded591fdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.344261 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1251/2495] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:46 2022] DELETE /identity/v3/projects/e44bdac4693642f282df95405efeaa35 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:46.349090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af03f-bf88-45ef-aa3e-a8d189250fde None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.349267 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af03f-bf88-45ef-aa3e-a8d189250fde None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.349549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af03f-bf88-45ef-aa3e-a8d189250fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.367629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-187af03f-bf88-45ef-aa3e-a8d189250fde None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:46.369321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-187af03f-bf88-45ef-aa3e-a8d189250fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.382852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.383720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.384006 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.384283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] PATH_INFO: `/v3/projects/59af3ab43a234c19867ff9fd27e0a98e` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.385526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59af3ab43a234c19867ff9fd27e0a98e)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.387523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.433048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1252/2496] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:46.438848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59af3ab43a234c19867ff9fd27e0a98e', 'request_id': 'req-53a68829-4253-4043-b86b-52ca47c85c5b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.440858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.441540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.441540 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.447519 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59af3ab43a234c19867ff9fd27e0a98e', 'request_id': 'req-53a68829-4253-4043-b86b-52ca47c85c5b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.462397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59af3ab43a234c19867ff9fd27e0a98e', 'request_id': 'req-53a68829-4253-4043-b86b-52ca47c85c5b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.466092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:46.467783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.476990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] The token cache is being invalidate because project 59af3ab43a234c19867ff9fd27e0a98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:46.477422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.478174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-53a68829-4253-4043-b86b-52ca47c85c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.480408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1245/2497] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:46 2022] DELETE /identity/v3/projects/59af3ab43a234c19867ff9fd27e0a98e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:46.485032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f85cf8-b365-4294-b7e3-c199a447cc04 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.485232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f85cf8-b365-4294-b7e3-c199a447cc04 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.485520 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f85cf8-b365-4294-b7e3-c199a447cc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.507221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a0f85cf8-b365-4294-b7e3-c199a447cc04 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:46.508515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a0f85cf8-b365-4294-b7e3-c199a447cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.534038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1253/2498] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:46.537690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.539730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.564996 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1246/2499] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:46.566048 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f85cf8-b365-4294-b7e3-c199a447cc04 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.574918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f85cf8-b365-4294-b7e3-c199a447cc04 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.579490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed00a1-3ee7-4398-864e-8621fccdd818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.580286 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed00a1-3ee7-4398-864e-8621fccdd818 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.580402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed00a1-3ee7-4398-864e-8621fccdd818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.580662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed00a1-3ee7-4398-864e-8621fccdd818 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.581446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed00a1-3ee7-4398-864e-8621fccdd818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:46.581752 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed00a1-3ee7-4398-864e-8621fccdd818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.583380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed00a1-3ee7-4398-864e-8621fccdd818 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.598515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1247/2500] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:46.598515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129102c-4ab0-476a-ac89-7383be9bd5ae None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.598515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129102c-4ab0-476a-ac89-7383be9bd5ae None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.598515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129102c-4ab0-476a-ac89-7383be9bd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.598930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e05d7-5689-4f0d-b2be-a160b2807d51 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.602395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.603039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.603318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.603591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.605400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.615580 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7129102c-4ab0-476a-ac89-7383be9bd5ae None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:46.616769 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7129102c-4ab0-476a-ac89-7383be9bd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.617694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.619446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.625035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1248/2501] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:46.625841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129102c-4ab0-476a-ac89-7383be9bd5ae None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.629283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1254/2502] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:46.630070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.635966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129102c-4ab0-476a-ac89-7383be9bd5ae None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.638982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870963-efc8-4217-bc38-761590fb5036 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.641326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.641989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.642261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.642534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.643223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.643667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.644351 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.644638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.644942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.645207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.645672 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:46.645980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.647555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.662633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1255/2503] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:46.663928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.674696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d301f-70ef-40be-bedd-aeb27e48b995 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.675729 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1249/2504] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:46.679970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.738771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.739791 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.740407 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.740884 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.741757 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.743322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a85ba-299b-43bb-b4b4-31a1098b9cc3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.744756 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.750543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.751775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.752275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.752806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.754146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.757882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.778127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1256/2505] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:46.782173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.793344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1250/2506] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:46.794902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.807058 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908337f-8e93-4b64-bf0d-0338845be564 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.857632 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4a67-6f30-423e-8f10-bdc602b03449 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.863181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.863440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.863726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.864007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.864749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.866687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.870853 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.872270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.872549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.872975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.873715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.875311 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.887719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1251/2507] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:46.891759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.896451 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1257/2508] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:46 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:46.897390 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.899108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:46.909272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ae361-c88c-411f-80b1-2be325918920 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.911356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712890-d775-4f71-aa7f-edde67a992f0 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.913974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.914641 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.914932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.915180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.915900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.916571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.917052 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.917330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.917606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] PATH_INFO: `/v3/users/e0c430b1281f406ca43df22ace5c64b5` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.917851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.918829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c430b1281f406ca43df22ace5c64b5)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.920888 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.930954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1252/2509] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:46.930954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.941142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3db93-34ea-4848-9fe4-39c479fe275a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.945830 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.946534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.946850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.947131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.948141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.950171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:46.962722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1253/2510] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:46.963681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:46.974726 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82510ed6-76b3-43e9-ba07-061587707b81 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:46.975911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c430b1281f406ca43df22ace5c64b5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.976816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c430b1281f406ca43df22ace5c64b5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.980405 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:46.981377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:46.981639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:46.981978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] PATH_INFO: `/v3/projects/426995b88b2444fca52c3b6863a0ffce/users/38a76fd736614424add9ea45e6de77ec/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:46.990146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c430b1281f406ca43df22ace5c64b5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:46.998157 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] RBAC: Authorizing `identity:create_grant(project_id=426995b88b2444fca52c3b6863a0ffce, user_id=38a76fd736614424add9ea45e6de77ec, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:46.999294 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c430b1281f406ca43df22ace5c64b5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:47.001019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.007911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-6303f143-b7f0-4b35-b7ef-646a4d842e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c430b1281f406ca43df22ace5c64b5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:47.014721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1254/2511] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:46 2022] PUT /identity/v3/projects/426995b88b2444fca52c3b6863a0ffce/users/38a76fd736614424add9ea45e6de77ec/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:47.015565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.016448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1258/2512] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:46 2022] DELETE /identity/v3/users/e0c430b1281f406ca43df22ace5c64b5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:47.017206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.028785 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa3b9-33ab-422b-8420-637a2429fa6b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.029376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa3b9-33ab-422b-8420-637a2429fa6b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.029754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa3b9-33ab-422b-8420-637a2429fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.057754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c53fa3b9-33ab-422b-8420-637a2429fa6b None None] MFA Rules not processed for user `38a76fd736614424add9ea45e6de77ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:47.059011 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c53fa3b9-33ab-422b-8420-637a2429fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.085920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d75a5-3993-4621-982b-f716bf7c74df admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.130410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1259/2513] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:47.132038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.132326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.132599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.146485 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.147177 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.147458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.147733 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.148472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.150158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.150527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:47.151743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.163694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1260/2514] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:47.163919 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1255/2515] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:47.164046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.164995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.170380 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.175075 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b377f4d-7961-4ffe-91ed-a5eb214a8488 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.180955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.182050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.182333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.182610 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] PATH_INFO: `/v3/projects/e5ea986ec58644d6bbe0e22286f8456f/users/7a1e4cabff104e2ba911927a32854e75/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.182820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd047153-10db-4d80-b33e-1b3c4dbd5dd2 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.188328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.189032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.189310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.189578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.190278 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.192401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.198503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ea986ec58644d6bbe0e22286f8456f, user_id=7a1e4cabff104e2ba911927a32854e75, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.201198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.219843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1256/2516] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:47 2022] PUT /identity/v3/projects/e5ea986ec58644d6bbe0e22286f8456f/users/7a1e4cabff104e2ba911927a32854e75/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:47.221438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1261/2517] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:47.222031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.228783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.229779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.292131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9213-e0af-475b-b935-63c6fa323d67 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.297998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23892565-c183-4d4f-8a58-6aa52f4d30ae admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.303509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed209e9-a790-457c-aa94-83264f0daf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.304193 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed209e9-a790-457c-aa94-83264f0daf82 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.304471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed209e9-a790-457c-aa94-83264f0daf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.304771 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed209e9-a790-457c-aa94-83264f0daf82 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.305471 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed209e9-a790-457c-aa94-83264f0daf82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.307401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed209e9-a790-457c-aa94-83264f0daf82 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.328546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1262/2518] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:47.331661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c882f6-01b3-4cc6-b8fc-e9e4f3179104 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.331973 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c882f6-01b3-4cc6-b8fc-e9e4f3179104 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.332253 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c882f6-01b3-4cc6-b8fc-e9e4f3179104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.347599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.348253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.348530 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.348832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.359358 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.360954 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-28c882f6-01b3-4cc6-b8fc-e9e4f3179104 None None] MFA Rules not processed for user `7a1e4cabff104e2ba911927a32854e75`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:47.361454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.362166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-28c882f6-01b3-4cc6-b8fc-e9e4f3179104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.373360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1257/2519] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:47.374373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.384364 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8070e20-5493-455e-8d04-a47ca3f6fda3 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.391695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.392384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.392666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.394238 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.394976 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.396589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.409938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1258/2520] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:47.416887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.437230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2647-8dea-4d9b-8c64-472f9e3cde89 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.442263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.443163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.443445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.443723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] PATH_INFO: `/v3/projects/1991d470c4494186895e2d16b6f369a4/users/a45191a383304691a1477bcaef3c39c3/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.453963 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1263/2521] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:47.456015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c882f6-01b3-4cc6-b8fc-e9e4f3179104 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.465389 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1991d470c4494186895e2d16b6f369a4, user_id=a45191a383304691a1477bcaef3c39c3, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.468164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.469690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c882f6-01b3-4cc6-b8fc-e9e4f3179104 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.476171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.477304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.477591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.477860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.478568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.480538 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.487227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1259/2522] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:47 2022] PUT /identity/v3/projects/1991d470c4494186895e2d16b6f369a4/users/a45191a383304691a1477bcaef3c39c3/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:47.491449 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.515616 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1264/2523] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:47.516838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.566191 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c23514-e322-4e5d-ba7e-0675102eb7d6 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.595086 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1b910-402c-436c-a2d3-805d84409586 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.602990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.603706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.603874 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.604179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.604923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.606868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.632189 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1265/2524] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:47.633185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.634977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.645395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.646077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.646360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.646633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.647373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.647485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee3d5-96e1-4ebf-9c80-be41ac0e37a3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.649242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.654565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.655430 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.655715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.655996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] PATH_INFO: `/v3/projects/158ffa09a81c43409bf2767c74516f39` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.657231 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=158ffa09a81c43409bf2767c74516f39)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.659852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.660124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1260/2525] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:47.661112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.671419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66610-0ae7-4191-b158-b6e4b312553e admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.676291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.676975 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.677261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.677537 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.678267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.679928 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.690534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1261/2526] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:47.691367 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.701819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721cec9-6712-4333-bac5-3cfb0033d837 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.710510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158ffa09a81c43409bf2767c74516f39', 'request_id': 'req-eb1bddf0-9868-4417-b15b-367a2ab73ea3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:47.718988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158ffa09a81c43409bf2767c74516f39', 'request_id': 'req-eb1bddf0-9868-4417-b15b-367a2ab73ea3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:47.728223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158ffa09a81c43409bf2767c74516f39', 'request_id': 'req-eb1bddf0-9868-4417-b15b-367a2ab73ea3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:47.739584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] The token cache is being invalidate because project 158ffa09a81c43409bf2767c74516f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:47.739903 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:47.740571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:47.742449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1266/2527] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:47 2022] DELETE /identity/v3/projects/158ffa09a81c43409bf2767c74516f39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:47.746203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:47.747953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.767875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9928ac-7a64-427c-a904-8a5a577836dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.769004 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9928ac-7a64-427c-a904-8a5a577836dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.769287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9928ac-7a64-427c-a904-8a5a577836dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.769563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9928ac-7a64-427c-a904-8a5a577836dc admin admin] PATH_INFO: `/v3/projects/1991d470c4494186895e2d16b6f369a4/users/a45191a383304691a1477bcaef3c39c3/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.771701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9928ac-7a64-427c-a904-8a5a577836dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1991d470c4494186895e2d16b6f369a4, user_id=a45191a383304691a1477bcaef3c39c3, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.774357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9928ac-7a64-427c-a904-8a5a577836dc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.785227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1262/2528] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:47 2022] PUT /identity/v3/projects/1991d470c4494186895e2d16b6f369a4/users/a45191a383304691a1477bcaef3c39c3/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:47.786553 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98608a62-0d62-4135-aa43-45c87e69b174 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.786971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98608a62-0d62-4135-aa43-45c87e69b174 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.787821 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98608a62-0d62-4135-aa43-45c87e69b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.806379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-98608a62-0d62-4135-aa43-45c87e69b174 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:47.807621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-98608a62-0d62-4135-aa43-45c87e69b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.817536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bddf0-9868-4417-b15b-367a2ab73ea3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:47.878375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1263/2529] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:47.878375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ce5d8-743c-49e0-bb80-b157f0b143e2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.878375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ce5d8-743c-49e0-bb80-b157f0b143e2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.878375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ce5d8-743c-49e0-bb80-b157f0b143e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.889504 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfdf61-7c17-444b-9992-092a2a03dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:47.890389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfdf61-7c17-444b-9992-092a2a03dd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.890671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfdf61-7c17-444b-9992-092a2a03dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.890946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfdf61-7c17-444b-9992-092a2a03dd78 admin admin] PATH_INFO: `/v3/projects/3e31c17b5eb34d259744221cdd89876a/users/cd6070a71b23409dbe2c349c28bcf612/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.901035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e84ce5d8-743c-49e0-bb80-b157f0b143e2 None None] MFA Rules not processed for user `a45191a383304691a1477bcaef3c39c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:47.902241 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e84ce5d8-743c-49e0-bb80-b157f0b143e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.911005 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cfdf61-7c17-444b-9992-092a2a03dd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e31c17b5eb34d259744221cdd89876a, user_id=cd6070a71b23409dbe2c349c28bcf612, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:47.913827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cfdf61-7c17-444b-9992-092a2a03dd78 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:47.929531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1267/2530] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:47 2022] PUT /identity/v3/projects/3e31c17b5eb34d259744221cdd89876a/users/cd6070a71b23409dbe2c349c28bcf612/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:47.930999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:47.931285 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:47.931562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:47.949097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:47.950312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:47.995526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1264/2531] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:47.995526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ce5d8-743c-49e0-bb80-b157f0b143e2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.013544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ce5d8-743c-49e0-bb80-b157f0b143e2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.050770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1268/2532] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:48.052164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.054424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:48.085483 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.086386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.086676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.086955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.088574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.091489 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.107863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1265/2533] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:48.107863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.117384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3edd96-9244-4356-8e68-433cb15fb72e admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.126484 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.127170 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.127394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe4330-7a4c-4e0d-85cb-8862f5e19a99 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.127539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.127715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.128531 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:48.128886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.130548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.133352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713d791-f305-4e84-9a6d-40116f1281bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.134148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d791-f305-4e84-9a6d-40116f1281bb service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.134437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d791-f305-4e84-9a6d-40116f1281bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.134711 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d791-f305-4e84-9a6d-40116f1281bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.150408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1266/2534] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:48.150408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.163230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0659-09f8-4c1b-bf92-05d036b32be3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.168766 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.169683 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.169964 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.170242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] PATH_INFO: `/v3/projects/3e31c17b5eb34d259744221cdd89876a/users/cd6070a71b23409dbe2c349c28bcf612/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.173012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e31c17b5eb34d259744221cdd89876a, user_id=cd6070a71b23409dbe2c349c28bcf612, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.176038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.187205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1267/2535] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:48 2022] PUT /identity/v3/projects/3e31c17b5eb34d259744221cdd89876a/users/cd6070a71b23409dbe2c349c28bcf612/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:48.196710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.222002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713d791-f305-4e84-9a6d-40116f1281bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.223603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713d791-f305-4e84-9a6d-40116f1281bb service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.235931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1269/2536] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:48.237270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb32ff-830d-4938-8f4f-f39d8764d094 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.237601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb32ff-830d-4938-8f4f-f39d8764d094 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.237877 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb32ff-830d-4938-8f4f-f39d8764d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.260414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dfa79-bd50-4d5d-9695-5287e1c354ba admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.266356 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.267257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.267706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.268103 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.268962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.270977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8fdb32ff-830d-4938-8f4f-f39d8764d094 None None] MFA Rules not processed for user `cd6070a71b23409dbe2c349c28bcf612`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:48.271111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.272548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8fdb32ff-830d-4938-8f4f-f39d8764d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:48.308758 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1268/2537] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:48 2022] POST /identity/v3/projects => generated 397 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:48.313012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.368754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1270/2538] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:48.381486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb32ff-830d-4938-8f4f-f39d8764d094 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.408757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ea059-6699-42c0-a030-fc6b1d91163f admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.417142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.418332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.418634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.418959 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.420363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.422786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.453393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb32ff-830d-4938-8f4f-f39d8764d094 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.459738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1269/2539] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:48 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:48.463941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.476147 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e75515-e3a4-4b69-96d1-7475c6b0e219 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.482796 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.483775 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.484212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.484639 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.486767 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.489873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.505275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1270/2540] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:48.509094 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.520570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8395f-96c3-4f00-9e7b-7955cc3db891 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.525789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.526702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.527112 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.527447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.528448 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.530434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.530667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.531360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.531707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.532099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.546558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1271/2541] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:48.549600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.560008 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a9a1-86c3-4356-9254-07248c47764d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.581762 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a806a-3a54-42df-97c0-40002a14fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.582837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a806a-3a54-42df-97c0-40002a14fd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.583128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a806a-3a54-42df-97c0-40002a14fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.583408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a806a-3a54-42df-97c0-40002a14fd72 admin admin] PATH_INFO: `/v3/projects/46d2e3bc9f7e4e75967f2b0e5bee354f/users/e6106e06ac7d4f8d99d39c7f11b39bd4/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.610031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a806a-3a54-42df-97c0-40002a14fd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d2e3bc9f7e4e75967f2b0e5bee354f, user_id=e6106e06ac7d4f8d99d39c7f11b39bd4, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.613154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.614678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.616805 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a806a-3a54-42df-97c0-40002a14fd72 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.627250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1271/2542] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:48.649980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1272/2543] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:48 2022] PUT /identity/v3/projects/46d2e3bc9f7e4e75967f2b0e5bee354f/users/e6106e06ac7d4f8d99d39c7f11b39bd4/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:48.685955 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.721888 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72aed7-1b1e-4483-9730-97376f66d8e6 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.722184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72aed7-1b1e-4483-9730-97376f66d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.722466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72aed7-1b1e-4483-9730-97376f66d8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.749944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7b72aed7-1b1e-4483-9730-97376f66d8e6 None None] MFA Rules not processed for user `e6106e06ac7d4f8d99d39c7f11b39bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:48.751245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7b72aed7-1b1e-4483-9730-97376f66d8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:48.799523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff9082-7e88-4f25-ac27-96f6468a6da7 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.840295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1273/2544] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:48.841815 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72aed7-1b1e-4483-9730-97376f66d8e6 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.874281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45191a383304691a1477bcaef3c39c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1991d470c4494186895e2d16b6f369a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.875281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.875575 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.875858 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.876598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:48.877077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.878782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.892469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1272/2545] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:48.896852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:48.898779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:48.915817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72aed7-1b1e-4483-9730-97376f66d8e6 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.919842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.920518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.920882 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.921166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.928188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:48.964431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4537e-0685-40a2-9558-510e3b37d45a tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:48.969292 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:48.970269 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:48.970739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:48.971166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:48.982539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:48.984481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:48.999474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1273/2546] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:49.011024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:49.018250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:49.019925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:49.035591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056905a-1168-4a81-91ff-f13d090bf171 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:49.042757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1274/2547] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:49.047739 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45191a383304691a1477bcaef3c39c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1991d470c4494186895e2d16b6f369a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:49.048416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:49.048717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:49.049003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:49.049718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:49.051675 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:49.116763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1274/2548] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:48 2022] POST /identity/v3/projects => generated 355 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:49.119739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:49.138546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884d102-c010-46ca-929c-52cd8d10c3a0 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:49.267102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45191a383304691a1477bcaef3c39c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1991d470c4494186895e2d16b6f369a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:49.268531 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:49.269327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:49.269965 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:49.279720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:49.280424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:49.285003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:49.324949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1275/2549] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:49.378552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:49.390686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262d618-dc17-4b6e-956f-0f4394c0b331 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:49.397116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45191a383304691a1477bcaef3c39c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1991d470c4494186895e2d16b6f369a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:49.398104 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:49.398490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:49.398981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] PATH_INFO: `/v3/projects/194106d7f29f45a18c0696cd0329a375` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:49.400553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorizing `identity:delete_project(project_id=194106d7f29f45a18c0696cd0329a375)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:49.402571 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:49.472087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194106d7f29f45a18c0696cd0329a375', 'request_id': 'req-a1284fd0-66ee-45cf-abb1-888df69a8855'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.481851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194106d7f29f45a18c0696cd0329a375', 'request_id': 'req-a1284fd0-66ee-45cf-abb1-888df69a8855'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.489473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194106d7f29f45a18c0696cd0329a375', 'request_id': 'req-a1284fd0-66ee-45cf-abb1-888df69a8855'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.500363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] The token cache is being invalidate because project 194106d7f29f45a18c0696cd0329a375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:49.500655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.501450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a1284fd0-66ee-45cf-abb1-888df69a8855 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.503318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1275/2550] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:49 2022] DELETE /identity/v3/projects/194106d7f29f45a18c0696cd0329a375 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:49.735374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:49.737921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:49.819941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec14f8-87f5-4488-b9d0-81636a720473 tempest-VolumeQuotaClassesTest-401942638 tempest-VolumeQuotaClassesTest-401942638-project-admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:49.879269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:49.880221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:49.880508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:49.880818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] PATH_INFO: `/v3/users/38a76fd736614424add9ea45e6de77ec` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:49.882065 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a76fd736614424add9ea45e6de77ec)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:49.884019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:49.938151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a76fd736614424add9ea45e6de77ec'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.939336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a76fd736614424add9ea45e6de77ec'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.948540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a76fd736614424add9ea45e6de77ec'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.961536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a76fd736614424add9ea45e6de77ec'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.973546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a76fd736614424add9ea45e6de77ec'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:49.984760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1276/2551] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:49 2022] DELETE /identity/v3/users/38a76fd736614424add9ea45e6de77ec => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:49.986182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:49.986661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:49.986855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:50.007960 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:50.009808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:50.094350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1276/2552] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:50.104332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:50.105883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:50.183182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9359ab-bd10-4127-8da4-6de12005c6c6 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:50.191548 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:50.192148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:50.192344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:50.192594 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:50.204407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:50.207161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:50.221669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1277/2553] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:50.492416 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:50.494796 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:50.512067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08e1d0-6143-44a3-bbff-98b77b5f2d30 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:50.519536 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:50.520441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:50.521164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:50.521164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] PATH_INFO: `/v3/users/ecc2540fdbe64849b897ae1b7cefe109` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:50.522223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc2540fdbe64849b897ae1b7cefe109)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:50.524426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:50.562420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:50.564140 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:50.590834 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8854ea-7878-4696-abab-f79c7b5299c4 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:50.604553 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc2540fdbe64849b897ae1b7cefe109'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.605355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc2540fdbe64849b897ae1b7cefe109'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.609154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:50.610029 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:50.610586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:50.610586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] PATH_INFO: `/v3/projects/426995b88b2444fca52c3b6863a0ffce` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:50.611924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=426995b88b2444fca52c3b6863a0ffce)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:50.614234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:50.624071 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc2540fdbe64849b897ae1b7cefe109'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.641400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc2540fdbe64849b897ae1b7cefe109'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.654121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc2540fdbe64849b897ae1b7cefe109'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.661918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1277/2554] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:50 2022] DELETE /identity/v3/users/ecc2540fdbe64849b897ae1b7cefe109 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:50.680700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426995b88b2444fca52c3b6863a0ffce', 'request_id': 'req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.690883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426995b88b2444fca52c3b6863a0ffce', 'request_id': 'req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.700142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426995b88b2444fca52c3b6863a0ffce', 'request_id': 'req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.717369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] The token cache is being invalidate because project 426995b88b2444fca52c3b6863a0ffce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:50.717837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.718507 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.720523 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1278/2555] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:50 2022] DELETE /identity/v3/projects/426995b88b2444fca52c3b6863a0ffce => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:50.724702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:50.726433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:50.849941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141de74-2c55-452e-980f-bf8adfeb7634 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:50.884424 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:50.885943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:50.942179 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:50.943070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:50.943327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:50.943598 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] PATH_INFO: `/v3/users/a45191a383304691a1477bcaef3c39c3` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:50.944842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45191a383304691a1477bcaef3c39c3)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:50.946794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:50.974891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3725726-73b7-4c65-bbcf-ceeca8f29f7c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:50.981320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:50.982274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:50.982558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:50.982841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] PATH_INFO: `/v3/projects/e17dd3da9fc545fc901dc35e62332ab6` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:50.984158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17dd3da9fc545fc901dc35e62332ab6)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:50.986118 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:50.993538 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45191a383304691a1477bcaef3c39c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:50.994234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45191a383304691a1477bcaef3c39c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.007151 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45191a383304691a1477bcaef3c39c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.016993 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45191a383304691a1477bcaef3c39c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.024097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d7f94cb0-cf3c-4991-9e54-e8a451a430ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45191a383304691a1477bcaef3c39c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.030340 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1278/2556] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:50 2022] DELETE /identity/v3/users/a45191a383304691a1477bcaef3c39c3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:51.033605 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17dd3da9fc545fc901dc35e62332ab6', 'request_id': 'req-baa34041-7e64-469a-a993-2c92c9b16905'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.041554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17dd3da9fc545fc901dc35e62332ab6', 'request_id': 'req-baa34041-7e64-469a-a993-2c92c9b16905'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.047849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17dd3da9fc545fc901dc35e62332ab6', 'request_id': 'req-baa34041-7e64-469a-a993-2c92c9b16905'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.058266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] The token cache is being invalidate because project e17dd3da9fc545fc901dc35e62332ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:51.058559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.059182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-baa34041-7e64-469a-a993-2c92c9b16905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.060742 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1279/2557] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:50 2022] DELETE /identity/v3/projects/e17dd3da9fc545fc901dc35e62332ab6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:51.065900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bb9a-63b0-4a0e-b49b-fc5acf76fcbc None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.066287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bb9a-63b0-4a0e-b49b-fc5acf76fcbc None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.066631 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bb9a-63b0-4a0e-b49b-fc5acf76fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.085717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-e259bb9a-63b0-4a0e-b49b-fc5acf76fcbc None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:51.087159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e259bb9a-63b0-4a0e-b49b-fc5acf76fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:51.155828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1279/2558] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:51.163282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c81b6-0ff7-4898-a794-261fa0c16c05 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.163674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c81b6-0ff7-4898-a794-261fa0c16c05 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.163900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c81b6-0ff7-4898-a794-261fa0c16c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.196384 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5b9c81b6-0ff7-4898-a794-261fa0c16c05 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:51.197855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5b9c81b6-0ff7-4898-a794-261fa0c16c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:51.206123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1280/2559] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:51.210160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bb9a-63b0-4a0e-b49b-fc5acf76fcbc None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.219829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bb9a-63b0-4a0e-b49b-fc5acf76fcbc None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.225344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.226164 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.226459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.226737 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.227531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:51.227841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.229490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.243681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1280/2560] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:51.248083 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c81b6-0ff7-4898-a794-261fa0c16c05 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.257879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c81b6-0ff7-4898-a794-261fa0c16c05 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.262934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.263628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.263915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.264196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.264949 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.267691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.296583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1281/2561] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:51.300900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.309230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.311570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:51.311814 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261cf6e-4b46-4b2b-b350-46b388f84934 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.372334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.373210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.373596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.374039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.374829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.376928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.379199 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab96b5f-e8df-45dd-bc11-18ad0e9c88f2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.383918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.384952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.385237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.385542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] PATH_INFO: `/v3/projects/1991d470c4494186895e2d16b6f369a4` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.386736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1991d470c4494186895e2d16b6f369a4)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.388619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.397460 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1281/2562] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:51.401466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.410998 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed87d-7cba-409e-89c1-3c3271bd8958 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.415622 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.416272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.416558 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.416879 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.417613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.419566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.430633 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1282/2563] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:51.435581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.442271 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1991d470c4494186895e2d16b6f369a4', 'request_id': 'req-d4808a2b-df7b-4109-9c0a-37e4d8908393'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.446736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3a3f-d218-4f78-b11b-4cef0975423a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.450614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1991d470c4494186895e2d16b6f369a4', 'request_id': 'req-d4808a2b-df7b-4109-9c0a-37e4d8908393'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.457403 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1991d470c4494186895e2d16b6f369a4', 'request_id': 'req-d4808a2b-df7b-4109-9c0a-37e4d8908393'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.467509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] The token cache is being invalidate because project 1991d470c4494186895e2d16b6f369a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:51.467800 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.468461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d4808a2b-df7b-4109-9c0a-37e4d8908393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:51.473687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1282/2564] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:51 2022] DELETE /identity/v3/projects/1991d470c4494186895e2d16b6f369a4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:51.475459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0358ce-434b-4ea8-9a41-06c6bcf2ed92 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.475684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0358ce-434b-4ea8-9a41-06c6bcf2ed92 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.475958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0358ce-434b-4ea8-9a41-06c6bcf2ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.494235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ef0358ce-434b-4ea8-9a41-06c6bcf2ed92 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:51.495455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ef0358ce-434b-4ea8-9a41-06c6bcf2ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:51.503226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.503905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.504186 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.504463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.505276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.506898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.516725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1283/2565] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:51.520917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.522557 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:51.534537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc37e3-3f90-4f4e-a164-e3913836dabe admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.539118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff609e-a878-46f6-ad9c-9062aeaffd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.539990 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff609e-a878-46f6-ad9c-9062aeaffd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.540272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff609e-a878-46f6-ad9c-9062aeaffd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.540546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff609e-a878-46f6-ad9c-9062aeaffd65 admin admin] PATH_INFO: `/v3/projects/bdf4e343513a4f21b7d619416f04c785/users/92e943dcfa984a0b9345e8c8641f6441/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.554135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1283/2566] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:51.555720 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff609e-a878-46f6-ad9c-9062aeaffd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf4e343513a4f21b7d619416f04c785, user_id=92e943dcfa984a0b9345e8c8641f6441, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.558442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff609e-a878-46f6-ad9c-9062aeaffd65 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.561849 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9d860-c7d8-4d91-9978-3faad5b2cf64 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.562143 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9d860-c7d8-4d91-9978-3faad5b2cf64 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.562428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9d860-c7d8-4d91-9978-3faad5b2cf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.573835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1284/2567] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:51 2022] PUT /identity/v3/projects/bdf4e343513a4f21b7d619416f04c785/users/92e943dcfa984a0b9345e8c8641f6441/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:51.581526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-adf9d860-c7d8-4d91-9978-3faad5b2cf64 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:51.582714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-adf9d860-c7d8-4d91-9978-3faad5b2cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:51.584759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a42d4-7f3a-493b-a65b-8a63e5ab9f71 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.585049 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a42d4-7f3a-493b-a65b-8a63e5ab9f71 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.585323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a42d4-7f3a-493b-a65b-8a63e5ab9f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.611220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-180a42d4-7f3a-493b-a65b-8a63e5ab9f71 None None] MFA Rules not processed for user `92e943dcfa984a0b9345e8c8641f6441`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:51.612561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-180a42d4-7f3a-493b-a65b-8a63e5ab9f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:51.640950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1284/2568] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:51.645432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9d860-c7d8-4d91-9978-3faad5b2cf64 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.653895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9d860-c7d8-4d91-9978-3faad5b2cf64 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.658468 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.659104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.659410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.659680 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.660401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:51.660735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.662310 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.676859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1285/2569] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:04:51.677028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1285/2570] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:51.677808 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.679986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a42d4-7f3a-493b-a65b-8a63e5ab9f71 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.686938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26702f-c591-4d3c-808f-a33c35ce825b admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.689904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a42d4-7f3a-493b-a65b-8a63e5ab9f71 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.691428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.692052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.692335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.692602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.693344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.694562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.695188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.695298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.695478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.695755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.696436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.698347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.721105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1286/2571] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:51.723828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1286/2572] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:51.725196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.728013 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.789994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740d18-a09d-4a8e-8e1d-3028c89bb790 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.795226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.795899 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.796185 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.796571 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.797301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.798660 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c876de6-56f2-4359-a2ea-a36a5ef8af91 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.799227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.803443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.804102 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.804382 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.804652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.805364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.807250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.823341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1287/2573] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:04:51.824604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.826687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1287/2574] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:51 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:51.830334 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.834751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e8ac-20ac-48df-bfea-7b8b01f2aeda admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.839700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cef5ab-3140-4888-b4c4-8c4a2455d631 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.839874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.840372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.840735 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.840960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.841722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.843301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.844690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.845329 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.845605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.845876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.846588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.848213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.854007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1288/2575] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:51.857837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.858268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1288/2576] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:51.861881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.868217 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087702db-5152-48f4-9dd0-b6a82453b5fe admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.871628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de48e-7aa1-4422-ac23-949bcefcd1cb admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.873950 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.874691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.875041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.875390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.876187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.876306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.877121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.877401 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.877724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] PATH_INFO: `/v3/projects/f8c36aac579e4646944758e2bcea4329/users/abcfe0029b444c2c8a90a67154d620f5/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.878010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.888325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1289/2577] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:51.892190 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c36aac579e4646944758e2bcea4329, user_id=abcfe0029b444c2c8a90a67154d620f5, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.892487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.894878 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.902561 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e7bb-d1ea-408c-ba57-1a153f135ff3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.909744 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1289/2578] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:51 2022] PUT /identity/v3/projects/f8c36aac579e4646944758e2bcea4329/users/abcfe0029b444c2c8a90a67154d620f5/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:51.914105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:51.962348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.963368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.963656 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.963931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] PATH_INFO: `/v3/projects/6258601d279a402a8238cdf6a5c63a5f/users/4722c23d750540849a18e49495e5efcf/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.980429 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8742b7e-f538-4a93-811d-13b37b135084 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:51.982428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6258601d279a402a8238cdf6a5c63a5f, user_id=4722c23d750540849a18e49495e5efcf, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.985233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.985353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79657a-785c-43fd-903d-1f4768d88ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:51.985905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79657a-785c-43fd-903d-1f4768d88ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:51.986183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79657a-785c-43fd-903d-1f4768d88ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:51.986461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79657a-785c-43fd-903d-1f4768d88ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:51.987222 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79657a-785c-43fd-903d-1f4768d88ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:51.988967 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79657a-785c-43fd-903d-1f4768d88ba7 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:51.999022 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1290/2579] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:51 2022] PUT /identity/v3/projects/6258601d279a402a8238cdf6a5c63a5f/users/4722c23d750540849a18e49495e5efcf/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:52.003579 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1290/2580] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:52.006887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:52.011195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.011591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.011881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.038719 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] MFA Rules not processed for user `4722c23d750540849a18e49495e5efcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:52.039942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:52.071721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d6aa7-172b-4f6d-b743-9e9540c48dd6 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:52.077120 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa782-97c1-4584-a5ab-c9dbd991c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:52.078067 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa782-97c1-4584-a5ab-c9dbd991c9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.078344 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa782-97c1-4584-a5ab-c9dbd991c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.078611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa782-97c1-4584-a5ab-c9dbd991c9fd admin admin] PATH_INFO: `/v3/projects/f8c36aac579e4646944758e2bcea4329/users/abcfe0029b444c2c8a90a67154d620f5/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.080982 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa782-97c1-4584-a5ab-c9dbd991c9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c36aac579e4646944758e2bcea4329, user_id=abcfe0029b444c2c8a90a67154d620f5, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:52.083760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa782-97c1-4584-a5ab-c9dbd991c9fd admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:52.097375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1291/2581] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:52 2022] PUT /identity/v3/projects/f8c36aac579e4646944758e2bcea4329/users/abcfe0029b444c2c8a90a67154d620f5/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:52.107968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1291/2582] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:52.110225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.110652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.111037 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.144279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] MFA Rules not processed for user `abcfe0029b444c2c8a90a67154d620f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:52.144762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:52.145563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:52.146211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:52.209680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96238f-18dd-49c6-8b28-9640a8dce181 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:52.218937 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1292/2583] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:52.230644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:52.231954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:52.257782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:52.258443 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.258728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.259061 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.287409 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9e9b-0122-43cd-a39f-95f76dc16e08 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:52.291165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:52.291847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.292119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.292395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.302223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:52.303664 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:52.313223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1293/2584] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:52.314350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:52.315794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:52.324930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1292/2585] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:52.339328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:52.389749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:52.398191 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990312e-15a8-4161-beca-bada4e985e48 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:52.402095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e119ad-3133-41b9-b3d1-17a711a81f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:52.402738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e119ad-3133-41b9-b3d1-17a711a81f74 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.403018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e119ad-3133-41b9-b3d1-17a711a81f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.403167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e51b-b4ca-4317-aa8d-f874ae86d6fd service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:52.403293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e119ad-3133-41b9-b3d1-17a711a81f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.407832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:52.408731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.409019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.409325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] PATH_INFO: `/v3/users/4722c23d750540849a18e49495e5efcf` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.410540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4722c23d750540849a18e49495e5efcf)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:52.412439 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:52.462786 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4722c23d750540849a18e49495e5efcf'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:52.463438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4722c23d750540849a18e49495e5efcf'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:52.463956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e119ad-3133-41b9-b3d1-17a711a81f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:52.465464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e119ad-3133-41b9-b3d1-17a711a81f74 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:52.472855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4722c23d750540849a18e49495e5efcf'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:52.475017 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1293/2586] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:04:52.485989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4722c23d750540849a18e49495e5efcf'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:52.493365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4722c23d750540849a18e49495e5efcf'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:52.499862 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1294/2587] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:52 2022] DELETE /identity/v3/users/4722c23d750540849a18e49495e5efcf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:04:52.504653 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.505031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.505306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.522594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:52.523847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:52.589001 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1294/2588] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:52.599266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:52.601009 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:52.658054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756de49-4f2a-4b00-a081-601c9043ae3a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:52.662002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516187d8-c4e1-4395-8bda-55464bd5323a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:52.662648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516187d8-c4e1-4395-8bda-55464bd5323a service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.662930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516187d8-c4e1-4395-8bda-55464bd5323a service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.663205 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516187d8-c4e1-4395-8bda-55464bd5323a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.672244 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516187d8-c4e1-4395-8bda-55464bd5323a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:52.673693 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516187d8-c4e1-4395-8bda-55464bd5323a service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:52.685833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1295/2589] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:52.963305 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:52.964842 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:52.979824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060cf7-1578-4bf1-b12a-4970e2c5071b None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:52.984989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:52.986549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:52.986839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:52.987112 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] PATH_INFO: `/v3/projects/6258601d279a402a8238cdf6a5c63a5f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:52.988530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6258601d279a402a8238cdf6a5c63a5f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:52.990330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.038209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6258601d279a402a8238cdf6a5c63a5f', 'request_id': 'req-f9295752-bce8-40c0-bcd7-d44addffc321'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:53.046527 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6258601d279a402a8238cdf6a5c63a5f', 'request_id': 'req-f9295752-bce8-40c0-bcd7-d44addffc321'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:53.052949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6258601d279a402a8238cdf6a5c63a5f', 'request_id': 'req-f9295752-bce8-40c0-bcd7-d44addffc321'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:53.063192 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] The token cache is being invalidate because project 6258601d279a402a8238cdf6a5c63a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:04:53.063475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:53.064130 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f9295752-bce8-40c0-bcd7-d44addffc321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:53.065855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1295/2590] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:52 2022] DELETE /identity/v3/projects/6258601d279a402a8238cdf6a5c63a5f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:53.070841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7f1aa-cb5b-4c73-9dd5-c033d6fb0eca None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.071125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7f1aa-cb5b-4c73-9dd5-c033d6fb0eca None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.071394 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7f1aa-cb5b-4c73-9dd5-c033d6fb0eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.088953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-76f7f1aa-cb5b-4c73-9dd5-c033d6fb0eca None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:53.090136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-76f7f1aa-cb5b-4c73-9dd5-c033d6fb0eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:53.150615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1296/2591] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:53.158669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c115-9c58-4173-9e7d-3b13acaccfe7 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.158961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c115-9c58-4173-9e7d-3b13acaccfe7 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.159238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c115-9c58-4173-9e7d-3b13acaccfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.178721 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ca23c115-9c58-4173-9e7d-3b13acaccfe7 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:53.179936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ca23c115-9c58-4173-9e7d-3b13acaccfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:53.190002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1296/2592] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:53.194335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7f1aa-cb5b-4c73-9dd5-c033d6fb0eca None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:53.204306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7f1aa-cb5b-4c73-9dd5-c033d6fb0eca None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:53.210354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:53.211007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.211296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.211564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.212294 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:04:53.212599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:53.214224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.226298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1297/2593] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:04:53.230662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23c115-9c58-4173-9e7d-3b13acaccfe7 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:53.240138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23c115-9c58-4173-9e7d-3b13acaccfe7 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:53.245323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:53.245981 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.246262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.246644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.247465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:53.249341 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.277187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1297/2594] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:04:53 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:53.281607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:53.292181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2367197-c7ab-4981-91e7-52ada366cd8d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:53.351953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:53.352613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.352920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.353190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.353873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:53.355777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.382874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1298/2595] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:04:53 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:04:53.387801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:53.403603 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a50a-41f3-49a7-b010-f2c913376caf admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:53.411165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:53.411835 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.412111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.412392 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.413260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:53.414862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.425700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1298/2596] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:04:53.429777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:53.440226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325708c0-3b47-4381-b636-6fd5ca65d2f9 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:53.446218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10e0f9-04f5-4a93-96cd-01cb03aa1bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:53.446910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10e0f9-04f5-4a93-96cd-01cb03aa1bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.447192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10e0f9-04f5-4a93-96cd-01cb03aa1bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.447469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10e0f9-04f5-4a93-96cd-01cb03aa1bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.448234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10e0f9-04f5-4a93-96cd-01cb03aa1bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:53.449848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10e0f9-04f5-4a93-96cd-01cb03aa1bbf admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.462292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1299/2597] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:04:53.466594 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:53.477042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9067a-2a83-4afb-a424-25aacfc8ec03 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:53.482281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:53.483181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.483464 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.483738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] PATH_INFO: `/v3/projects/8a803c29217e4388a684686173489d99/users/c5a18761923349d6bbc628ec46fa0764/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.498795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a803c29217e4388a684686173489d99, user_id=c5a18761923349d6bbc628ec46fa0764, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:53.501461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.519098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1299/2598] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:04:53 2022] PUT /identity/v3/projects/8a803c29217e4388a684686173489d99/users/c5a18761923349d6bbc628ec46fa0764/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:53.524401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6902d-caed-4335-aab3-d0468e1bb352 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.524718 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6902d-caed-4335-aab3-d0468e1bb352 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.524997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6902d-caed-4335-aab3-d0468e1bb352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.543583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-45c6902d-caed-4335-aab3-d0468e1bb352 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:53.544778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-45c6902d-caed-4335-aab3-d0468e1bb352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:53.616872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1300/2599] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:53.626985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:53.629063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:53.690176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9d160-10c7-4b0b-a57a-e3fa99683c9f admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:53.695778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:53.696424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:53.696712 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:53.697022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:53.707426 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:53.708883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:53.719378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1300/2600] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:54.316119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021a8f-5486-4533-b5d1-49d514b267a0 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:54.316630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021a8f-5486-4533-b5d1-49d514b267a0 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:54.316630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021a8f-5486-4533-b5d1-49d514b267a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:54.343633 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-11021a8f-5486-4533-b5d1-49d514b267a0 None None] MFA Rules not processed for user `c5a18761923349d6bbc628ec46fa0764`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:54.345131 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-11021a8f-5486-4533-b5d1-49d514b267a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:54.411122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1301/2601] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:54.422069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:54.423735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:54.493381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627c5d3-1fec-4c0e-a12a-5c8fb9413883 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:54.497025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:54.497673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:54.497956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:54.498230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:54.506823 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:54.508254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:54.516968 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1301/2602] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:57.995301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86391055-dfc8-4165-8f29-940d81014add None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:57.995851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86391055-dfc8-4165-8f29-940d81014add None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:57.995851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86391055-dfc8-4165-8f29-940d81014add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:58.014236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-86391055-dfc8-4165-8f29-940d81014add None None] MFA Rules not processed for user `c5a18761923349d6bbc628ec46fa0764`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:58.015442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-86391055-dfc8-4165-8f29-940d81014add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:58.023404 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1302/2603] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:04:58.259661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:58.262747 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:58.275131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d98db6-8eca-4efc-9aa2-670471deecc7 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:58.278950 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd752a-25c4-4b96-9eb4-24f11908e227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:58.279611 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd752a-25c4-4b96-9eb4-24f11908e227 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:58.279897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd752a-25c4-4b96-9eb4-24f11908e227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:58.280174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd752a-25c4-4b96-9eb4-24f11908e227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:58.281939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5dbd752a-25c4-4b96-9eb4-24f11908e227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:58.291863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd752a-25c4-4b96-9eb4-24f11908e227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:58.293331 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd752a-25c4-4b96-9eb4-24f11908e227 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:58.304868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1302/2604] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:59.392518 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86391055-dfc8-4165-8f29-940d81014add None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:59.394204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-86391055-dfc8-4165-8f29-940d81014add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:59.409487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86391055-dfc8-4165-8f29-940d81014add None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:59.415320 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:59.416188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:59.416474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:59.416852 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] PATH_INFO: `/v3/users/e6106e06ac7d4f8d99d39c7f11b39bd4` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:59.418197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6106e06ac7d4f8d99d39c7f11b39bd4)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:59.420125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:59.468910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6106e06ac7d4f8d99d39c7f11b39bd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:59.469672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6106e06ac7d4f8d99d39c7f11b39bd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:59.480200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6106e06ac7d4f8d99d39c7f11b39bd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:59.492025 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6106e06ac7d4f8d99d39c7f11b39bd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:59.499386 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6106e06ac7d4f8d99d39c7f11b39bd4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:04:59.505814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1303/2605] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:04:59 2022] DELETE /identity/v3/users/e6106e06ac7d4f8d99d39c7f11b39bd4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:04:59.510513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:59.510902 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:59.511097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:59.530177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:04:59.531934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:59.591131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1303/2606] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:04:59.602798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:59.604408 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:59.663469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa3266-0a32-416e-a3e7-61c847d02135 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:59.667572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068a5aa-f311-4429-8d50-b9723c148e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:59.668222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068a5aa-f311-4429-8d50-b9723c148e33 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:59.668504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068a5aa-f311-4429-8d50-b9723c148e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:59.668810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068a5aa-f311-4429-8d50-b9723c148e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:59.678492 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068a5aa-f311-4429-8d50-b9723c148e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:59.679908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068a5aa-f311-4429-8d50-b9723c148e33 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:04:59.689401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1304/2607] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:04:59.967185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:04:59.968956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:04:59.982211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace3ee3-1e86-4cef-a6a4-6db8c2aee3e3 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:04:59.987869 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:04:59.988982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:04:59.989255 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:04:59.989531 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] PATH_INFO: `/v3/projects/46d2e3bc9f7e4e75967f2b0e5bee354f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:04:59.990854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d2e3bc9f7e4e75967f2b0e5bee354f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:04:59.992999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.041224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d2e3bc9f7e4e75967f2b0e5bee354f', 'request_id': 'req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:00.051355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d2e3bc9f7e4e75967f2b0e5bee354f', 'request_id': 'req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:00.057635 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d2e3bc9f7e4e75967f2b0e5bee354f', 'request_id': 'req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:00.067550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] The token cache is being invalidate because project 46d2e3bc9f7e4e75967f2b0e5bee354f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:00.067830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:00.068509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-2f6038a6-c1ae-4b8f-a0ab-bc6cc94dceef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:00.070131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1304/2608] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:04:59 2022] DELETE /identity/v3/projects/46d2e3bc9f7e4e75967f2b0e5bee354f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:00.075089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd3d6-9278-4522-b3ee-5db67879a31b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.075377 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd3d6-9278-4522-b3ee-5db67879a31b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.075652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd3d6-9278-4522-b3ee-5db67879a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.093520 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-383cd3d6-9278-4522-b3ee-5db67879a31b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:00.094714 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-383cd3d6-9278-4522-b3ee-5db67879a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:00.155163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1305/2609] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:00.163165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0519ec8-03a4-49a4-a3c9-ce7346ac2c41 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.163454 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0519ec8-03a4-49a4-a3c9-ce7346ac2c41 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.163755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0519ec8-03a4-49a4-a3c9-ce7346ac2c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.183216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d0519ec8-03a4-49a4-a3c9-ce7346ac2c41 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:00.184313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d0519ec8-03a4-49a4-a3c9-ce7346ac2c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:00.193105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1305/2610] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:00.197455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd3d6-9278-4522-b3ee-5db67879a31b None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:00.208066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd3d6-9278-4522-b3ee-5db67879a31b None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:00.214231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:00.214933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.215208 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.215526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.216297 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:00.216658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:00.218479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.230590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1306/2611] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:05:00.235161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0519ec8-03a4-49a4-a3c9-ce7346ac2c41 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:00.245445 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0519ec8-03a4-49a4-a3c9-ce7346ac2c41 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:00.251555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:00.252220 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.252507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.252846 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.253544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:00.255485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.284617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1306/2612] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:00 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:00.289233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:00.299178 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5789c9-91f6-4a3a-aaf7-0606e1c539f1 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:00.360084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:00.360741 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.361053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.361329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.362021 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:00.363913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.387819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1307/2613] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:00 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:00.391992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:00.402659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2bdd-1357-4f9e-a1e8-4560f58e2cff admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:00.408127 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:00.408920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.409174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.409446 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.410216 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:00.411816 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.422319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1307/2614] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:00.426472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:00.436935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43998-111b-4d43-a44e-d4bf422160fe admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:00.442089 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ed5b-dbf4-40ac-b178-2ae15737efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:00.442753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ed5b-dbf4-40ac-b178-2ae15737efd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.443039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ed5b-dbf4-40ac-b178-2ae15737efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.443363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ed5b-dbf4-40ac-b178-2ae15737efd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.444101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ed5b-dbf4-40ac-b178-2ae15737efd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:00.445724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ed5b-dbf4-40ac-b178-2ae15737efd2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.455832 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1308/2615] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:00.460120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:00.470411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ed460-41f2-4a5a-a958-263c44b9b520 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:00.475175 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:00.476045 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.476323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.476592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] PATH_INFO: `/v3/projects/2eec603f7854489393b8c4ed68874746/users/e6a3e88ec7374302a4e6fd98d018a187/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.491586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eec603f7854489393b8c4ed68874746, user_id=e6a3e88ec7374302a4e6fd98d018a187, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:00.494724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.510161 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1308/2616] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:00 2022] PUT /identity/v3/projects/2eec603f7854489393b8c4ed68874746/users/e6a3e88ec7374302a4e6fd98d018a187/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:00.515559 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.515854 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.516138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.534632 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:00.535864 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:00.594111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1309/2617] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:00.607303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:00.610125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:00.675281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f301429-6285-4504-86cd-0580b88e9864 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:00.679412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de685a0-1ce8-4b56-b8a3-4bb426d3f250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:00.680067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de685a0-1ce8-4b56-b8a3-4bb426d3f250 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:00.680403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de685a0-1ce8-4b56-b8a3-4bb426d3f250 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:00.680692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de685a0-1ce8-4b56-b8a3-4bb426d3f250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:00.690643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de685a0-1ce8-4b56-b8a3-4bb426d3f250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:00.692014 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de685a0-1ce8-4b56-b8a3-4bb426d3f250 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:00.701793 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1309/2618] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:03.578807 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:03.580957 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:03.593723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae6d4-87a6-447c-a6e6-73f882452c0e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:03.599936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:03.601053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:03.601925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:03.602146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] PATH_INFO: `/v3/users/7a1e4cabff104e2ba911927a32854e75` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:03.603549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1e4cabff104e2ba911927a32854e75)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:03.605651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:03.663935 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1e4cabff104e2ba911927a32854e75'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:03.664908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1e4cabff104e2ba911927a32854e75'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:03.674387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1e4cabff104e2ba911927a32854e75'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:03.691215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1e4cabff104e2ba911927a32854e75'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:03.699842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1e4cabff104e2ba911927a32854e75'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:03.707374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1310/2619] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:03 2022] DELETE /identity/v3/users/7a1e4cabff104e2ba911927a32854e75 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:03.716196 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:03.716590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:03.716710 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:03.739937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:03.742003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:03.812808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1310/2620] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:03.825302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:03.827321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:03.894894 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1be4a5-72cc-4bf4-90e7-afe13dedf843 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:03.899397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:03.900280 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:03.901486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:03.901906 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:03.914027 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:03.916083 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:03.926207 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1311/2621] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:04.785861 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:04.787512 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:04.810142 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b6837-5fe1-45e1-bc8f-cfe90e2a67f1 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:04.818494 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:04.819805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:04.820212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:04.820582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] PATH_INFO: `/v3/projects/e5ea986ec58644d6bbe0e22286f8456f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:04.824254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ea986ec58644d6bbe0e22286f8456f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:04.826839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:04.913592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ea986ec58644d6bbe0e22286f8456f', 'request_id': 'req-773770e8-6915-4d72-908f-26f054cb0285'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:04.929640 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ea986ec58644d6bbe0e22286f8456f', 'request_id': 'req-773770e8-6915-4d72-908f-26f054cb0285'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:04.937433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ea986ec58644d6bbe0e22286f8456f', 'request_id': 'req-773770e8-6915-4d72-908f-26f054cb0285'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:04.953786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] The token cache is being invalidate because project e5ea986ec58644d6bbe0e22286f8456f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:04.954087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:04.954966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:04.959373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1311/2622] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:04 2022] DELETE /identity/v3/projects/e5ea986ec58644d6bbe0e22286f8456f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:04.964690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:04.981578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562b780-26af-461a-b847-14bed58dc3f5 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:05.042640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:05.043589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:05.043869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:05.044192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] PATH_INFO: `/v3/users/cd6070a71b23409dbe2c349c28bcf612` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:05.045626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6070a71b23409dbe2c349c28bcf612)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:05.048102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:05.106847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6070a71b23409dbe2c349c28bcf612'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.107556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6070a71b23409dbe2c349c28bcf612'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.123350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6070a71b23409dbe2c349c28bcf612'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.157121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6070a71b23409dbe2c349c28bcf612'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.165061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0a5f04f4-aa73-42e1-8f96-b581eaafeba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6070a71b23409dbe2c349c28bcf612'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.186223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1312/2623] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:04 2022] DELETE /identity/v3/users/cd6070a71b23409dbe2c349c28bcf612 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:05.597405 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:05.599283 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:05.617756 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773770e8-6915-4d72-908f-26f054cb0285 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:05.714516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:05.716402 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:05.716883 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:05.717325 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] PATH_INFO: `/v3/projects/3e31c17b5eb34d259744221cdd89876a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:05.718880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e31c17b5eb34d259744221cdd89876a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:05.721587 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:05.784980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e31c17b5eb34d259744221cdd89876a', 'request_id': 'req-a13295f8-4fd3-4444-be68-ce65dd46f708'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.794241 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e31c17b5eb34d259744221cdd89876a', 'request_id': 'req-a13295f8-4fd3-4444-be68-ce65dd46f708'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.802937 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e31c17b5eb34d259744221cdd89876a', 'request_id': 'req-a13295f8-4fd3-4444-be68-ce65dd46f708'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.818139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] The token cache is being invalidate because project 3e31c17b5eb34d259744221cdd89876a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:05.818538 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.820135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a13295f8-4fd3-4444-be68-ce65dd46f708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:05.822479 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1312/2624] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:05 2022] DELETE /identity/v3/projects/3e31c17b5eb34d259744221cdd89876a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:05.827370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cea1f-4cf2-46cf-b2d5-f93c49ad2460 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:05.828597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cea1f-4cf2-46cf-b2d5-f93c49ad2460 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:05.829108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cea1f-4cf2-46cf-b2d5-f93c49ad2460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:05.862587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-675cea1f-4cf2-46cf-b2d5-f93c49ad2460 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:05.864117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-675cea1f-4cf2-46cf-b2d5-f93c49ad2460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:05.975799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1313/2625] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:05.983884 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82382c49-d4f5-4e4a-b472-c10a9267af6c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:05.984988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82382c49-d4f5-4e4a-b472-c10a9267af6c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:05.985438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82382c49-d4f5-4e4a-b472-c10a9267af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.010339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-82382c49-d4f5-4e4a-b472-c10a9267af6c None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:06.011562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-82382c49-d4f5-4e4a-b472-c10a9267af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:06.026445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cea1f-4cf2-46cf-b2d5-f93c49ad2460 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.033058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1313/2626] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:06.039209 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cea1f-4cf2-46cf-b2d5-f93c49ad2460 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.045097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.046348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.046782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.047232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.048575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:06.049371 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.052444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.069220 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1314/2627] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:05:06.073956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82382c49-d4f5-4e4a-b472-c10a9267af6c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.096118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82382c49-d4f5-4e4a-b472-c10a9267af6c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.103958 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.105044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.106373 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.106838 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.108039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.114681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.154552 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1314/2628] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:06 2022] POST /identity/v3/projects => generated 355 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:06.159417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.171534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa81a3-218b-4e9d-a5eb-4339014de49c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.256339 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.257304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.257987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.258586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.259264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.261671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.294889 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1315/2629] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:06 2022] POST /identity/v3/users => generated 278 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:06.297890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.308254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b539-a5cf-4b65-a9eb-6e4060509eba admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.313188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.313868 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.314149 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.314422 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.315260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.316930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.331377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1315/2630] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:06.335670 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.346435 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512649b-120a-4d23-bf3c-cac071575f32 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.351268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7de4b5-2e4f-4b7e-b3a9-c4c1e66d0bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.351945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de4b5-2e4f-4b7e-b3a9-c4c1e66d0bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.352301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de4b5-2e4f-4b7e-b3a9-c4c1e66d0bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.352503 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de4b5-2e4f-4b7e-b3a9-c4c1e66d0bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.353457 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de4b5-2e4f-4b7e-b3a9-c4c1e66d0bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.355233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de4b5-2e4f-4b7e-b3a9-c4c1e66d0bb0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.372324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.372613 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1316/2631] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:06.383953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c2af9-20c3-409d-ae38-2c9f97e43727 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.390073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.391182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.391486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.391758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] PATH_INFO: `/v3/projects/9193dac390314482a832c23f21ea0c34/users/beec61e2213d4dd4804fc12437f6a835/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.407825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9193dac390314482a832c23f21ea0c34, user_id=beec61e2213d4dd4804fc12437f6a835, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.411098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.433171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1316/2632] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:06 2022] PUT /identity/v3/projects/9193dac390314482a832c23f21ea0c34/users/beec61e2213d4dd4804fc12437f6a835/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:06.444574 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea32c7-88d2-4df1-b28c-74e9c2b29e58 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.444857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea32c7-88d2-4df1-b28c-74e9c2b29e58 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.445096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea32c7-88d2-4df1-b28c-74e9c2b29e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.472091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c1ea32c7-88d2-4df1-b28c-74e9c2b29e58 None None] MFA Rules not processed for user `beec61e2213d4dd4804fc12437f6a835`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:06.473436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c1ea32c7-88d2-4df1-b28c-74e9c2b29e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:06.539969 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1317/2633] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:06 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:06.544642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.606952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4b18-ef7c-4577-a39a-abfc8966963e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.612038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.612697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.613018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.613291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.613992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.616126 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.653268 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1317/2634] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:06 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:06.657296 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea32c7-88d2-4df1-b28c-74e9c2b29e58 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.668360 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea32c7-88d2-4df1-b28c-74e9c2b29e58 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.738477 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.739167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.739464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.739872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.740610 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.743016 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.764539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1318/2635] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:06 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:06.768459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.778781 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2b263-d055-41be-9d5c-57c375d6109d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.783997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.784778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.785132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.785507 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.786319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.788843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.801090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1318/2636] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:06.806325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.822536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9239-81bf-4a71-bad9-11464de8c8ba admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.828218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68001af-4ac1-4d4c-8baf-901f354c1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.829172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68001af-4ac1-4d4c-8baf-901f354c1d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.829511 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68001af-4ac1-4d4c-8baf-901f354c1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.829990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68001af-4ac1-4d4c-8baf-901f354c1d7d admin admin] PATH_INFO: `/v3/projects/89559300d23e4868b0fa3db507c16df8/users/e289835f45014fd7afd90a843c7a23fb/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.853799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68001af-4ac1-4d4c-8baf-901f354c1d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89559300d23e4868b0fa3db507c16df8, user_id=e289835f45014fd7afd90a843c7a23fb, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.856620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68001af-4ac1-4d4c-8baf-901f354c1d7d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.871848 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1319/2637] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:06 2022] PUT /identity/v3/projects/89559300d23e4868b0fa3db507c16df8/users/e289835f45014fd7afd90a843c7a23fb/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:06.875589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.885923 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e360a98-f1c3-4473-9f6b-e706b52a7f16 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.900933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.901226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.901565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.931345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] MFA Rules not processed for user `e6a3e88ec7374302a4e6fd98d018a187`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:06.932569 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:06.956772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.957718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.957718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.957956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.959050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:06.961136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:06.979098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1319/2638] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:06.980578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:06.991318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a35b-f9c0-43fb-89fb-ed39949225a6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:06.996297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2303b4f-f737-4679-97f1-666700c69f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:06.997224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303b4f-f737-4679-97f1-666700c69f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:06.997500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303b4f-f737-4679-97f1-666700c69f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:06.997804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303b4f-f737-4679-97f1-666700c69f9b admin admin] PATH_INFO: `/v3/projects/89559300d23e4868b0fa3db507c16df8/users/e289835f45014fd7afd90a843c7a23fb/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:06.999827 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2303b4f-f737-4679-97f1-666700c69f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89559300d23e4868b0fa3db507c16df8, user_id=e289835f45014fd7afd90a843c7a23fb, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.001255 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1320/2639] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:07.002583 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2303b4f-f737-4679-97f1-666700c69f9b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.005956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.007362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:07.013146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1320/2640] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:06 2022] PUT /identity/v3/projects/89559300d23e4868b0fa3db507c16df8/users/e289835f45014fd7afd90a843c7a23fb/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:07.021751 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac42d69-5081-4b80-94bd-e8d2939e83ec None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.026638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.026931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.027211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.055774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] MFA Rules not processed for user `e289835f45014fd7afd90a843c7a23fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:07.057039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:07.086601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.087897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.087897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.088124 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.089078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.091155 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.132880 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1321/2641] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:07 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:07.134402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.148910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1321/2642] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:07 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:07.162591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.164461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:07.248309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4eb11-9849-47c9-882a-5461bf3c6d44 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.253473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.254366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.254645 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.255080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.255933 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.258105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.268964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5d6bd-282f-4fbd-a761-44abd56f3edb None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.292839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1322/2643] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:07 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:07.296390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.319398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8449a3c-6b09-45a6-a815-5fb25e31372e admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.330749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.331904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.332387 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.332867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.333979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.335918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.349345 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1323/2644] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:07.353925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.366171 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e9bf-fa5c-478a-bc61-490a6bec156d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.375967 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.377083 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.377907 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.378338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] PATH_INFO: `/v3/projects/3edc3b8b7c564e348105d0218d64b958/users/bc64c21c0d534e81a44d36c72fc88c16/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.402232 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edc3b8b7c564e348105d0218d64b958, user_id=bc64c21c0d534e81a44d36c72fc88c16, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.404909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.425565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.434679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.434971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.435257 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.442093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1324/2645] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:07 2022] PUT /identity/v3/projects/3edc3b8b7c564e348105d0218d64b958/users/bc64c21c0d534e81a44d36c72fc88c16/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:07.444167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.589298 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.590787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.600119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e37abe-f326-4fa2-9954-38f6e81846ba admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.607254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1322/2646] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:07 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:05:07.607487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.608237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.608662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.609093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.609839 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.611635 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.623436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1325/2647] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:07.627641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.639576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71d039-5603-4396-8364-02a09faec6af service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.656213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72d192-70ed-4894-adc0-b69f991b82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.657519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72d192-70ed-4894-adc0-b69f991b82ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.657864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72d192-70ed-4894-adc0-b69f991b82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.658228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72d192-70ed-4894-adc0-b69f991b82ba admin admin] PATH_INFO: `/v3/projects/3edc3b8b7c564e348105d0218d64b958/users/bc64c21c0d534e81a44d36c72fc88c16/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.664497 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72d192-70ed-4894-adc0-b69f991b82ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edc3b8b7c564e348105d0218d64b958, user_id=bc64c21c0d534e81a44d36c72fc88c16, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.674755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72d192-70ed-4894-adc0-b69f991b82ba admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.701055 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1323/2648] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:07 2022] PUT /identity/v3/projects/3edc3b8b7c564e348105d0218d64b958/users/bc64c21c0d534e81a44d36c72fc88c16/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:07.744690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:07.816600 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbf445-7761-41fb-abd9-6cacbe35bb47 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:07.876816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:07.878081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:07.878606 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:07.879050 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:07.959646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:07.961172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:07.972722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1326/2649] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:07 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:12.929481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be047612-61d8-41b6-8110-7c429bbde498 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:12.929949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be047612-61d8-41b6-8110-7c429bbde498 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:12.930047 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be047612-61d8-41b6-8110-7c429bbde498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:12.976100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-be047612-61d8-41b6-8110-7c429bbde498 None None] MFA Rules not processed for user `bc64c21c0d534e81a44d36c72fc88c16`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:12.978475 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-be047612-61d8-41b6-8110-7c429bbde498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:13.083038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1324/2650] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:13.100217 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:13.101910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:13.208165 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726cc87-48e3-437b-8a24-ea51ca968d36 service cinder] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:13.215059 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff92eb-5ee7-4087-b8d3-fea6e07d0bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:13.215725 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff92eb-5ee7-4087-b8d3-fea6e07d0bfb service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:13.216012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff92eb-5ee7-4087-b8d3-fea6e07d0bfb service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:13.216292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff92eb-5ee7-4087-b8d3-fea6e07d0bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:13.272181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff92eb-5ee7-4087-b8d3-fea6e07d0bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:13.273883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff92eb-5ee7-4087-b8d3-fea6e07d0bfb service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:13.284541 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1327/2651] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:14.406584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03afc1-44e6-4351-b5aa-ba9ea6734b16 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:14.407068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03afc1-44e6-4351-b5aa-ba9ea6734b16 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:14.407166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03afc1-44e6-4351-b5aa-ba9ea6734b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:14.424872 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-8d03afc1-44e6-4351-b5aa-ba9ea6734b16 None None] MFA Rules not processed for user `e6a3e88ec7374302a4e6fd98d018a187`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:14.426072 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-8d03afc1-44e6-4351-b5aa-ba9ea6734b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:14.433053 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1325/2652] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:19.833224 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7004cc-5227-4bde-92f0-e060a230a768 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:19.833708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7004cc-5227-4bde-92f0-e060a230a768 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:19.833804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7004cc-5227-4bde-92f0-e060a230a768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:19.854035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ed7004cc-5227-4bde-92f0-e060a230a768 None None] MFA Rules not processed for user `c5a18761923349d6bbc628ec46fa0764`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:19.855253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ed7004cc-5227-4bde-92f0-e060a230a768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:19.914174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1328/2653] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:27.255750 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03afc1-44e6-4351-b5aa-ba9ea6734b16 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:27.318813 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03afc1-44e6-4351-b5aa-ba9ea6734b16 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:27.326289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:27.327254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:27.327568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:27.327855 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] PATH_INFO: `/v3/users/beec61e2213d4dd4804fc12437f6a835` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:27.329290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beec61e2213d4dd4804fc12437f6a835)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:27.331478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:27.385894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beec61e2213d4dd4804fc12437f6a835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.386546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beec61e2213d4dd4804fc12437f6a835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.397808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beec61e2213d4dd4804fc12437f6a835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.406108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beec61e2213d4dd4804fc12437f6a835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.413088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beec61e2213d4dd4804fc12437f6a835'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.418924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1326/2654] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:27 2022] DELETE /identity/v3/users/beec61e2213d4dd4804fc12437f6a835 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:27.423640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:27.424150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:27.424150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:27.443897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:27.445139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:27.511932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1329/2655] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:27.522046 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:27.523566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:27.582682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3a45f-8de6-4248-be90-49e6f23f3cd6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:27.586352 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:27.586999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:27.587286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:27.587562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:27.599642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:27.601125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:27.611092 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1327/2656] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:27.890857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:27.892353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:27.904473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7360ffa-f0d0-47f8-b943-2f75565a11a3 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:27.909543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:27.910419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:27.910701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:27.910995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] PATH_INFO: `/v3/projects/9193dac390314482a832c23f21ea0c34` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:27.912221 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9193dac390314482a832c23f21ea0c34)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:27.914172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:27.960651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9193dac390314482a832c23f21ea0c34', 'request_id': 'req-120accdb-96e8-4b31-ba55-04cb1db8875c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.968558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9193dac390314482a832c23f21ea0c34', 'request_id': 'req-120accdb-96e8-4b31-ba55-04cb1db8875c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.976110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9193dac390314482a832c23f21ea0c34', 'request_id': 'req-120accdb-96e8-4b31-ba55-04cb1db8875c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.990031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] The token cache is being invalidate because project 9193dac390314482a832c23f21ea0c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:27.990399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.991249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:27.993251 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1330/2657] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:27 2022] DELETE /identity/v3/projects/9193dac390314482a832c23f21ea0c34 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:27.997367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:28.007664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab338-c590-46d3-a878-5f9bbe146572 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:28.066132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:28.067031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.067314 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.067576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] PATH_INFO: `/v3/users/e289835f45014fd7afd90a843c7a23fb` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.068847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e289835f45014fd7afd90a843c7a23fb)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:28.070762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:28.117483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e289835f45014fd7afd90a843c7a23fb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.118299 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e289835f45014fd7afd90a843c7a23fb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.132696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e289835f45014fd7afd90a843c7a23fb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.141585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e289835f45014fd7afd90a843c7a23fb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.148436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-d1bec3e0-4fb7-4ed3-a0b6-f7e7aecdc5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e289835f45014fd7afd90a843c7a23fb'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.154339 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1328/2658] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:27 2022] DELETE /identity/v3/users/e289835f45014fd7afd90a843c7a23fb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:28.438614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:28.441333 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:28.461427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120accdb-96e8-4b31-ba55-04cb1db8875c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:28.535602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:28.536470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.537181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.537463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] PATH_INFO: `/v3/projects/89559300d23e4868b0fa3db507c16df8` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.538681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89559300d23e4868b0fa3db507c16df8)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:28.541447 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:28.591351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89559300d23e4868b0fa3db507c16df8', 'request_id': 'req-cabadb88-62e3-42aa-9802-522dc23e32b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.599711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89559300d23e4868b0fa3db507c16df8', 'request_id': 'req-cabadb88-62e3-42aa-9802-522dc23e32b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.605997 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89559300d23e4868b0fa3db507c16df8', 'request_id': 'req-cabadb88-62e3-42aa-9802-522dc23e32b5'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.617521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] The token cache is being invalidate because project 89559300d23e4868b0fa3db507c16df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:28.617901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.618544 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cabadb88-62e3-42aa-9802-522dc23e32b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:28.620083 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1331/2659] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:28 2022] DELETE /identity/v3/projects/89559300d23e4868b0fa3db507c16df8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:28.624926 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce7479-d391-4c32-a055-516b4fb0d960 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.625458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce7479-d391-4c32-a055-516b4fb0d960 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.625458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce7479-d391-4c32-a055-516b4fb0d960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.643670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9dce7479-d391-4c32-a055-516b4fb0d960 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:28.644946 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9dce7479-d391-4c32-a055-516b4fb0d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:28.705642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1329/2660] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:28.714366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5976-bc6f-444d-b98f-55d8271d2763 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.714631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5976-bc6f-444d-b98f-55d8271d2763 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.714938 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5976-bc6f-444d-b98f-55d8271d2763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.734619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-601d5976-bc6f-444d-b98f-55d8271d2763 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:28.735787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-601d5976-bc6f-444d-b98f-55d8271d2763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:28.745436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1332/2661] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:28.750559 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce7479-d391-4c32-a055-516b4fb0d960 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:28.761107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce7479-d391-4c32-a055-516b4fb0d960 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:28.766639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:28.767324 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.767601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.767873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.768716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:28.769060 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:28.770766 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:28.783395 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1330/2662] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:05:28.788322 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5976-bc6f-444d-b98f-55d8271d2763 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:28.797987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5976-bc6f-444d-b98f-55d8271d2763 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:28.803161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:28.803863 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.804158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.804434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.805262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:28.807350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:28.838955 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1333/2663] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:28 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:28.840300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:28.856724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59429-0327-4cb5-914e-aa514eb188e3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:28.922167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:28.922847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.923276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.923699 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.924596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:28.926687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:28.950377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1331/2664] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:28 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:28.951630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:28.962098 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554c71-c151-4613-9f55-67c6714a878a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:28.966710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:28.967370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:28.967651 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:28.967929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:28.968652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:28.970349 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:28.981634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1334/2665] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:28.986243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:28.998715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475ed02-b0c6-411b-a498-5c05a39fdc4d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.003670 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922c4b-4a44-47b3-9752-df3ed9becc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.004347 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922c4b-4a44-47b3-9752-df3ed9becc21 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.004634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922c4b-4a44-47b3-9752-df3ed9becc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.004942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922c4b-4a44-47b3-9752-df3ed9becc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.005680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922c4b-4a44-47b3-9752-df3ed9becc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.007282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922c4b-4a44-47b3-9752-df3ed9becc21 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.020617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1332/2666] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:29.021971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.032260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc27a-c8ea-4fe6-9798-e57959eec7f4 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.038305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.039282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.039564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.039841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] PATH_INFO: `/v3/projects/bef2a14fa0554e938fe4dd11370ad80a/users/a9011eb696ed47789326551edf62ce00/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.057878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef2a14fa0554e938fe4dd11370ad80a, user_id=a9011eb696ed47789326551edf62ce00, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.061240 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.076266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1335/2667] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:29 2022] PUT /identity/v3/projects/bef2a14fa0554e938fe4dd11370ad80a/users/a9011eb696ed47789326551edf62ce00/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:29.089676 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b1d4-4fdd-4404-9777-54adc43eb4a2 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.090118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b1d4-4fdd-4404-9777-54adc43eb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.090591 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b1d4-4fdd-4404-9777-54adc43eb4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.125368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-9296b1d4-4fdd-4404-9777-54adc43eb4a2 None None] MFA Rules not processed for user `a9011eb696ed47789326551edf62ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:29.126605 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9296b1d4-4fdd-4404-9777-54adc43eb4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:29.190445 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1333/2668] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:29.195326 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.260304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bcf57-3e7d-4a63-a35c-b8b8cee0ad20 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.265197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.265861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.266145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.266422 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.267293 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.269231 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.296529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1336/2669] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:29 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:29.300576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296b1d4-4fdd-4404-9777-54adc43eb4a2 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.311650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296b1d4-4fdd-4404-9777-54adc43eb4a2 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.368780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.369493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.369772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.370044 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.370716 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.372625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.398649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1334/2670] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:29 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:29.402611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.413168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453067e0-5706-4c12-aedf-64b1014e25f2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.418809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.419474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.419758 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.420031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.420799 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.422393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.433524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1337/2671] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:29.438212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.448972 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f6ef-0bdf-4f19-a0f8-d52a44298d2b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.454155 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df08225-13f1-412b-a32f-ab34ee736a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.455020 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08225-13f1-412b-a32f-ab34ee736a59 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.455131 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08225-13f1-412b-a32f-ab34ee736a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.455344 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08225-13f1-412b-a32f-ab34ee736a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.456200 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df08225-13f1-412b-a32f-ab34ee736a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.457851 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df08225-13f1-412b-a32f-ab34ee736a59 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.468326 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1335/2672] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:29.472668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.482979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650f902-668b-46ca-9096-93dc66e14866 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.488292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.489193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.489470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.489745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] PATH_INFO: `/v3/projects/7fe73a92055e440185c08d6f6009d37f/users/4532095c2fe84286b55398756ab7435f/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.505539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe73a92055e440185c08d6f6009d37f, user_id=4532095c2fe84286b55398756ab7435f, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.508200 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.523923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1338/2673] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:29 2022] PUT /identity/v3/projects/7fe73a92055e440185c08d6f6009d37f/users/4532095c2fe84286b55398756ab7435f/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:29.534530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94ef7-b44d-4fca-a9bb-d0aa213014ea None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.534820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94ef7-b44d-4fca-a9bb-d0aa213014ea None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.535099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94ef7-b44d-4fca-a9bb-d0aa213014ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.562488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-6cb94ef7-b44d-4fca-a9bb-d0aa213014ea None None] MFA Rules not processed for user `4532095c2fe84286b55398756ab7435f`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:29.563705 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6cb94ef7-b44d-4fca-a9bb-d0aa213014ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:29.631800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1336/2674] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:29.637855 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.702986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9d0f-6811-40dd-91a8-27c28ef54336 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.707924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.708588 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.708900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.709186 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.709891 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.711779 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.741174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1339/2675] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:29 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:29.742787 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb94ef7-b44d-4fca-a9bb-d0aa213014ea None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.753900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb94ef7-b44d-4fca-a9bb-d0aa213014ea None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.808762 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.809355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.809639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.809917 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.810612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.812516 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.833783 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1337/2676] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:29 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:29.838019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.848549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95439879-8ea5-47a9-85a1-bb0bd610edaf admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.854469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.855106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.855390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.855668 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.856390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.858051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.869242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1340/2677] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:29.873275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.883063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857cb14-3b43-4f0e-8df0-164498ae1022 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:29.888054 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:29.888972 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:29.889290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:29.889555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] PATH_INFO: `/v3/projects/0fe0dba10b0c41a0aa806519a1941c4f/users/79d4c75140904b5cb69f7bb85823ebbc/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:29.905437 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe0dba10b0c41a0aa806519a1941c4f, user_id=79d4c75140904b5cb69f7bb85823ebbc, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:29.908139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:29.923074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1338/2678] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:29 2022] PUT /identity/v3/projects/0fe0dba10b0c41a0aa806519a1941c4f/users/79d4c75140904b5cb69f7bb85823ebbc/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:29.927677 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:29.938393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d9f7-247d-4290-a352-8b41a8d442bc admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:30.013736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d1233-95bb-4bf9-9690-dbff969b32fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:30.014412 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d1233-95bb-4bf9-9690-dbff969b32fc admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:30.014699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d1233-95bb-4bf9-9690-dbff969b32fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:30.014972 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d1233-95bb-4bf9-9690-dbff969b32fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:30.015708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d1233-95bb-4bf9-9690-dbff969b32fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:30.017353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d1233-95bb-4bf9-9690-dbff969b32fc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:30.030817 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1341/2679] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:30.035881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:30.046788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467682f9-08b1-4262-902c-454945b33680 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:30.052602 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:30.053515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:30.053800 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:30.054070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] PATH_INFO: `/v3/projects/0fe0dba10b0c41a0aa806519a1941c4f/users/79d4c75140904b5cb69f7bb85823ebbc/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:30.056348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe0dba10b0c41a0aa806519a1941c4f, user_id=79d4c75140904b5cb69f7bb85823ebbc, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:30.059079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:30.069730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1339/2680] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:30 2022] PUT /identity/v3/projects/0fe0dba10b0c41a0aa806519a1941c4f/users/79d4c75140904b5cb69f7bb85823ebbc/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:30.081666 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a89c-d40e-4ae1-98c7-19f2a01b1c36 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:30.081936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a89c-d40e-4ae1-98c7-19f2a01b1c36 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:30.082236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a89c-d40e-4ae1-98c7-19f2a01b1c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:30.113281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3e70a89c-d40e-4ae1-98c7-19f2a01b1c36 None None] MFA Rules not processed for user `79d4c75140904b5cb69f7bb85823ebbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:30.114475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3e70a89c-d40e-4ae1-98c7-19f2a01b1c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:30.186789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1342/2681] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:30.198059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:30.199909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:30.255700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc76d3a-c84a-4379-88cc-192fc3eba985 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:30.259447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:30.260124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:30.260409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:30.260695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:30.269775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:30.271201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:30.287295 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1340/2682] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:30.327732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70a89c-d40e-4ae1-98c7-19f2a01b1c36 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:30.338738 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70a89c-d40e-4ae1-98c7-19f2a01b1c36 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:30.343130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149335f-0933-470e-b3cc-90b888b9cf5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:30.343885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149335f-0933-470e-b3cc-90b888b9cf5f service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:30.344168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149335f-0933-470e-b3cc-90b888b9cf5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:30.344564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149335f-0933-470e-b3cc-90b888b9cf5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:30.409527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149335f-0933-470e-b3cc-90b888b9cf5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:30.411493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149335f-0933-470e-b3cc-90b888b9cf5f service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:30.422368 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1343/2683] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:35.443996 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:35.508896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecab78-a3d6-4e20-9bdd-ad6e559f3661 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:35.516303 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:35.517201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:35.517490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:35.517760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] PATH_INFO: `/v3/users/a9011eb696ed47789326551edf62ce00` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:35.519050 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9011eb696ed47789326551edf62ce00)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:35.521043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:35.570099 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9011eb696ed47789326551edf62ce00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:35.570740 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9011eb696ed47789326551edf62ce00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:35.582290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9011eb696ed47789326551edf62ce00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:35.590789 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9011eb696ed47789326551edf62ce00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:35.597656 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9011eb696ed47789326551edf62ce00'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:35.603293 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1341/2684] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:35 2022] DELETE /identity/v3/users/a9011eb696ed47789326551edf62ce00 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:35.607941 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:35.608426 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:35.608542 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:35.626440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:35.627578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:35.691944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1344/2685] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:35.701794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:35.703350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:35.766687 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002446-4149-4e7f-8faa-ebbdfa460b2c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:35.770880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:35.771539 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:35.771824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:35.772095 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:35.782476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:35.784059 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:35.793702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1342/2686] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:36.140265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:36.141706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:36.154198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bda3e-ed08-4306-a738-a21b7728f530 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:36.159634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:36.160556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:36.160998 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:36.161400 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] PATH_INFO: `/v3/projects/bef2a14fa0554e938fe4dd11370ad80a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:36.164472 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef2a14fa0554e938fe4dd11370ad80a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:36.164943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:36.220811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef2a14fa0554e938fe4dd11370ad80a', 'request_id': 'req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.229010 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef2a14fa0554e938fe4dd11370ad80a', 'request_id': 'req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.236254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef2a14fa0554e938fe4dd11370ad80a', 'request_id': 'req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.252305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] The token cache is being invalidate because project bef2a14fa0554e938fe4dd11370ad80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:36.252720 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.253392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.254995 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1345/2687] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:36 2022] DELETE /identity/v3/projects/bef2a14fa0554e938fe4dd11370ad80a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:36.259254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:36.268914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225381aa-e86c-4541-b9a7-392798025e6a service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:36.323111 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:36.323962 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:36.324240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:36.324513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] PATH_INFO: `/v3/users/4532095c2fe84286b55398756ab7435f` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:36.325730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4532095c2fe84286b55398756ab7435f)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:36.327715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:36.373673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4532095c2fe84286b55398756ab7435f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.374320 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4532095c2fe84286b55398756ab7435f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.385758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4532095c2fe84286b55398756ab7435f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.395652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4532095c2fe84286b55398756ab7435f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.402561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4532095c2fe84286b55398756ab7435f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.408829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1343/2688] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:36 2022] DELETE /identity/v3/users/4532095c2fe84286b55398756ab7435f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:36.686161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:36.687671 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:36.701602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1719251-1d53-46c4-b3dd-8b9927fc3ba7 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:36.765780 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:36.766676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:36.766958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:36.767215 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] PATH_INFO: `/v3/projects/7fe73a92055e440185c08d6f6009d37f` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:36.768495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe73a92055e440185c08d6f6009d37f)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:36.770430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:36.826002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe73a92055e440185c08d6f6009d37f', 'request_id': 'req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.833572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe73a92055e440185c08d6f6009d37f', 'request_id': 'req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.839961 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe73a92055e440185c08d6f6009d37f', 'request_id': 'req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.850631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] The token cache is being invalidate because project 7fe73a92055e440185c08d6f6009d37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:36.850925 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.851592 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.853228 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1346/2689] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:36 2022] DELETE /identity/v3/projects/7fe73a92055e440185c08d6f6009d37f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:36.857410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:36.858985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:36.873287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea325-ea8c-43f3-81e5-d531dd4bfc40 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:36.929629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:36.930411 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:36.930691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:36.930959 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] PATH_INFO: `/v3/users/79d4c75140904b5cb69f7bb85823ebbc` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:36.932153 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d4c75140904b5cb69f7bb85823ebbc)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:36.934115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:36.983195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d4c75140904b5cb69f7bb85823ebbc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.984028 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d4c75140904b5cb69f7bb85823ebbc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:36.997225 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d4c75140904b5cb69f7bb85823ebbc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.006279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d4c75140904b5cb69f7bb85823ebbc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.014022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d4c75140904b5cb69f7bb85823ebbc'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.020270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1344/2690] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:36 2022] DELETE /identity/v3/users/79d4c75140904b5cb69f7bb85823ebbc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:37.347363 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:37.349234 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:37.366287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c7fb-c19b-4617-b55b-f3f972a5ef0d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:37.440696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:37.441686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:37.441970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:37.442245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] PATH_INFO: `/v3/projects/0fe0dba10b0c41a0aa806519a1941c4f` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:37.443528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe0dba10b0c41a0aa806519a1941c4f)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:37.445455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:37.504578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe0dba10b0c41a0aa806519a1941c4f', 'request_id': 'req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.523354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe0dba10b0c41a0aa806519a1941c4f', 'request_id': 'req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.534257 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe0dba10b0c41a0aa806519a1941c4f', 'request_id': 'req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.548211 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] The token cache is being invalidate because project 0fe0dba10b0c41a0aa806519a1941c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:37.548504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.549275 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-cd8c2328-8ce2-4a73-a8a8-fcf517e016ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:37.551428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1347/2691] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:37 2022] DELETE /identity/v3/projects/0fe0dba10b0c41a0aa806519a1941c4f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:39.033215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:39.034985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:39.048859 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea437fc8-ac20-4dc8-823a-9a5385dfa690 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:39.109700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:39.110596 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:39.110876 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:39.111853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] PATH_INFO: `/v3/users/92e943dcfa984a0b9345e8c8641f6441` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:39.112734 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e943dcfa984a0b9345e8c8641f6441)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:39.114881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:39.171936 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e943dcfa984a0b9345e8c8641f6441'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.172696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e943dcfa984a0b9345e8c8641f6441'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.186021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e943dcfa984a0b9345e8c8641f6441'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.194992 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e943dcfa984a0b9345e8c8641f6441'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.203243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e943dcfa984a0b9345e8c8641f6441'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.212323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1345/2692] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:39 2022] DELETE /identity/v3/users/92e943dcfa984a0b9345e8c8641f6441 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:39.217338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:39.217840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:39.217990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:39.238225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:39.239778 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:39.299079 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1348/2693] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:39.309836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:39.311544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:39.373935 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fffd59-ac56-41f4-ac73-78eff388bad9 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:39.378378 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:39.379038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:39.379346 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:39.379629 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:39.389291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:39.390736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:39.401593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1346/2694] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:39.690579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:39.692077 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:39.705379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c29b-ec0e-40fe-a602-e0e395feeb79 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:39.710446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:39.711910 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:39.712316 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:39.712884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] PATH_INFO: `/v3/projects/bdf4e343513a4f21b7d619416f04c785` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:39.714279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf4e343513a4f21b7d619416f04c785)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:39.716187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:39.771768 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf4e343513a4f21b7d619416f04c785', 'request_id': 'req-f747e4c0-3430-45b6-be15-6c314e4c9627'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.780264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf4e343513a4f21b7d619416f04c785', 'request_id': 'req-f747e4c0-3430-45b6-be15-6c314e4c9627'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.786593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf4e343513a4f21b7d619416f04c785', 'request_id': 'req-f747e4c0-3430-45b6-be15-6c314e4c9627'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.798391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] The token cache is being invalidate because project bdf4e343513a4f21b7d619416f04c785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:39.798681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.801527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.801527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1349/2695] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:39 2022] DELETE /identity/v3/projects/bdf4e343513a4f21b7d619416f04c785 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:39.805287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:39.815615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663afaa1-ce9e-414d-8600-8ddab46c1217 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:39.877272 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:39.878171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:39.878448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:39.878718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] PATH_INFO: `/v3/users/abcfe0029b444c2c8a90a67154d620f5` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:39.879953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcfe0029b444c2c8a90a67154d620f5)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:39.881941 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:39.932002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcfe0029b444c2c8a90a67154d620f5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.932662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcfe0029b444c2c8a90a67154d620f5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.944156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcfe0029b444c2c8a90a67154d620f5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.953109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcfe0029b444c2c8a90a67154d620f5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.962584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-96d7d027-425c-46a6-a8b8-fd9b90c282bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcfe0029b444c2c8a90a67154d620f5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:39.968440 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1347/2696] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:39 2022] DELETE /identity/v3/users/abcfe0029b444c2c8a90a67154d620f5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:40.545865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:40.547470 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:40.584111 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747e4c0-3430-45b6-be15-6c314e4c9627 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:40.657777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:40.658700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:40.658985 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:40.659265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] PATH_INFO: `/v3/projects/f8c36aac579e4646944758e2bcea4329` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:40.660575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c36aac579e4646944758e2bcea4329)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:40.662585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:40.724948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c36aac579e4646944758e2bcea4329', 'request_id': 'req-048022a3-98e5-4aa8-b17d-24fa278e405d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:40.737936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c36aac579e4646944758e2bcea4329', 'request_id': 'req-048022a3-98e5-4aa8-b17d-24fa278e405d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:40.746032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c36aac579e4646944758e2bcea4329', 'request_id': 'req-048022a3-98e5-4aa8-b17d-24fa278e405d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:40.756702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] The token cache is being invalidate because project f8c36aac579e4646944758e2bcea4329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:40.756990 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:40.757646 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-048022a3-98e5-4aa8-b17d-24fa278e405d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:40.759226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1350/2697] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:40 2022] DELETE /identity/v3/projects/f8c36aac579e4646944758e2bcea4329 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:40.764218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaf10b-4489-49c3-89f2-9243388c2860 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:40.764736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaf10b-4489-49c3-89f2-9243388c2860 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:40.764911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaf10b-4489-49c3-89f2-9243388c2860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:40.784482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-7adaf10b-4489-49c3-89f2-9243388c2860 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:40.785776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7adaf10b-4489-49c3-89f2-9243388c2860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:40.845847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1348/2698] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:40.853810 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8cb52-ea4f-4023-8a7d-197c731c887a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:40.854123 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8cb52-ea4f-4023-8a7d-197c731c887a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:40.854411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8cb52-ea4f-4023-8a7d-197c731c887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:40.873268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c1d8cb52-ea4f-4023-8a7d-197c731c887a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:40.874497 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c1d8cb52-ea4f-4023-8a7d-197c731c887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:40.882760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1351/2699] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:40.887606 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaf10b-4489-49c3-89f2-9243388c2860 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:40.897662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaf10b-4489-49c3-89f2-9243388c2860 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:40.902837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:40.903508 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:40.903794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:40.904202 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:40.904970 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:40.905281 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:40.906986 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:40.922461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1349/2700] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:05:40.923701 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8cb52-ea4f-4023-8a7d-197c731c887a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:40.933417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8cb52-ea4f-4023-8a7d-197c731c887a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:40.939362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:40.940156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:40.940436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:40.940736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:40.941433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:40.943446 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:40.982144 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1352/2701] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:40 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:40.983849 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:40.999165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc9de-e7e6-4f72-87de-1a54bc2ca26c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.062586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.063284 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.063572 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.063847 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.064804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.067041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.092354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1350/2702] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:40 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:41.096354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.107672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d13e04-9929-432e-82b7-7bb55f3ae963 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.112884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.113576 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.113861 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.114141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.114883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.117212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.132724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1353/2703] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:41.135412 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.146345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012a52-f46e-4c00-99bb-c391a7f40c69 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.151365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd5214-7287-4d98-be30-221dd8dbc593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.152040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5214-7287-4d98-be30-221dd8dbc593 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.152321 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5214-7287-4d98-be30-221dd8dbc593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.152597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5214-7287-4d98-be30-221dd8dbc593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.153376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd5214-7287-4d98-be30-221dd8dbc593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.155094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd5214-7287-4d98-be30-221dd8dbc593 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.165610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1351/2704] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:41.169901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.192970 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ac3b9-fe11-44d1-92f8-ef45df59243c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.207619 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.208493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.208806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.209093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] PATH_INFO: `/v3/projects/00e5a6f908d449e8baf0266f6431a443/users/babf4950ab274bacb272ab8bbae43afc/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.226433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e5a6f908d449e8baf0266f6431a443, user_id=babf4950ab274bacb272ab8bbae43afc, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.229442 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.248787 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1354/2705] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:41 2022] PUT /identity/v3/projects/00e5a6f908d449e8baf0266f6431a443/users/babf4950ab274bacb272ab8bbae43afc/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:41.257335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55e28d-22d3-48c3-a674-9851f6e6645c None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.257870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55e28d-22d3-48c3-a674-9851f6e6645c None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.258346 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55e28d-22d3-48c3-a674-9851f6e6645c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.291767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-6b55e28d-22d3-48c3-a674-9851f6e6645c None None] MFA Rules not processed for user `babf4950ab274bacb272ab8bbae43afc`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:41.293023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-6b55e28d-22d3-48c3-a674-9851f6e6645c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:41.360852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1352/2706] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:41.365528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.434033 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941543-c0f2-476b-aff9-cbc6c7b5b765 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.440093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.440804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.441108 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.441565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.445401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.453327 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.481973 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1355/2707] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:41 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:41.483135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55e28d-22d3-48c3-a674-9851f6e6645c None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.495474 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55e28d-22d3-48c3-a674-9851f6e6645c None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.590094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.590896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.591244 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.591592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.592372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.595556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.636021 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1353/2708] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:41 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:41.637904 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.651031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf85796-43f9-4f11-ac2e-adefb9ba035d admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.658222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.659172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.659566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.660176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.661634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.663626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.675897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1356/2709] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:41.681610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.694501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e5891-e694-4e7a-bb74-956dba33b7da admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.700085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.701610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.701895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.702319 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] PATH_INFO: `/v3/projects/a0d37741bf1c46af8391652f6e2b6a27/users/acaa6a62e5c442ceb6252f6e7a677474/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.726376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d37741bf1c46af8391652f6e2b6a27, user_id=acaa6a62e5c442ceb6252f6e7a677474, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.729523 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.745665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1354/2710] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:41 2022] PUT /identity/v3/projects/a0d37741bf1c46af8391652f6e2b6a27/users/acaa6a62e5c442ceb6252f6e7a677474/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:41.749809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.771196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfa6d2-3d82-4420-b289-ba96e9b13037 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.888375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295b43-e987-45b4-a719-60012dc12fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.889133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295b43-e987-45b4-a719-60012dc12fda admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.889417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295b43-e987-45b4-a719-60012dc12fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.889940 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295b43-e987-45b4-a719-60012dc12fda admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.890908 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295b43-e987-45b4-a719-60012dc12fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.893350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295b43-e987-45b4-a719-60012dc12fda admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.907142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1357/2711] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:05:41.908811 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:41.925671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa9cf4-123b-41ed-8216-2575e0d4d6f2 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:41.932250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:41.933486 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.934012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.934502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] PATH_INFO: `/v3/projects/a0d37741bf1c46af8391652f6e2b6a27/users/acaa6a62e5c442ceb6252f6e7a677474/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:41.938224 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d37741bf1c46af8391652f6e2b6a27, user_id=acaa6a62e5c442ceb6252f6e7a677474, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:41.941839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:41.955447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1355/2712] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:41 2022] PUT /identity/v3/projects/a0d37741bf1c46af8391652f6e2b6a27/users/acaa6a62e5c442ceb6252f6e7a677474/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:41.967494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fce83-1fed-44ad-8f4d-08f615ea8bb1 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:41.968148 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fce83-1fed-44ad-8f4d-08f615ea8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:41.968647 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fce83-1fed-44ad-8f4d-08f615ea8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:42.006629 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-f48fce83-1fed-44ad-8f4d-08f615ea8bb1 None None] MFA Rules not processed for user `acaa6a62e5c442ceb6252f6e7a677474`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:42.008621 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f48fce83-1fed-44ad-8f4d-08f615ea8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:42.092365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1358/2713] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:42.107240 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:42.109931 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:42.178313 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d63382-da67-4cf5-9a60-4f095630992a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:42.182172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceec18-9058-4b4b-821a-60dada896bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:42.182735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceec18-9058-4b4b-821a-60dada896bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:42.183067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceec18-9058-4b4b-821a-60dada896bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:42.183287 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceec18-9058-4b4b-821a-60dada896bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:42.192595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ceec18-9058-4b4b-821a-60dada896bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:42.194056 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ceec18-9058-4b4b-821a-60dada896bc9 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:42.205680 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1356/2714] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:42.636206 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fce83-1fed-44ad-8f4d-08f615ea8bb1 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:42.694567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fce83-1fed-44ad-8f4d-08f615ea8bb1 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:42.699951 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:42.700858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:42.701142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:42.701456 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] PATH_INFO: `/v3/users/babf4950ab274bacb272ab8bbae43afc` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:42.702686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babf4950ab274bacb272ab8bbae43afc)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:42.704563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:42.752657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babf4950ab274bacb272ab8bbae43afc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:42.753591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babf4950ab274bacb272ab8bbae43afc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:42.760749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babf4950ab274bacb272ab8bbae43afc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:42.772269 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babf4950ab274bacb272ab8bbae43afc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:42.779279 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babf4950ab274bacb272ab8bbae43afc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:42.785282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1359/2715] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:42 2022] DELETE /identity/v3/users/babf4950ab274bacb272ab8bbae43afc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:42.789924 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:42.790211 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:42.790492 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:42.808385 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:42.809641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:42.878327 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1357/2716] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:42.888222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:42.889809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:42.948603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a428-85c2-4209-bc13-ba510cfa0986 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:42.952611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:42.953292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:42.953572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:42.953847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:42.962923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:42.964351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:42.973596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1360/2717] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:43.249418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:43.251162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:43.264187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c727b-9ada-4bf2-be90-f55e6ae33cde None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:43.269100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:43.270032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:43.270308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:43.270563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] PATH_INFO: `/v3/projects/00e5a6f908d449e8baf0266f6431a443` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:43.272007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e5a6f908d449e8baf0266f6431a443)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:43.273829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:43.322067 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e5a6f908d449e8baf0266f6431a443', 'request_id': 'req-7892765e-bd29-422e-9a3e-4770ca84e7c1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.330481 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e5a6f908d449e8baf0266f6431a443', 'request_id': 'req-7892765e-bd29-422e-9a3e-4770ca84e7c1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.336767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e5a6f908d449e8baf0266f6431a443', 'request_id': 'req-7892765e-bd29-422e-9a3e-4770ca84e7c1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.346700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] The token cache is being invalidate because project 00e5a6f908d449e8baf0266f6431a443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:43.346983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.347641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.349228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1358/2718] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:43 2022] DELETE /identity/v3/projects/00e5a6f908d449e8baf0266f6431a443 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:43.353380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:43.363230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ce8f4-81e0-471e-9a66-1f438b4f32b4 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:43.421197 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:43.422092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:43.422369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:43.422658 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] PATH_INFO: `/v3/users/acaa6a62e5c442ceb6252f6e7a677474` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:43.423915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acaa6a62e5c442ceb6252f6e7a677474)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:43.425845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:43.472032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acaa6a62e5c442ceb6252f6e7a677474'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.472828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acaa6a62e5c442ceb6252f6e7a677474'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.481000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acaa6a62e5c442ceb6252f6e7a677474'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.499843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acaa6a62e5c442ceb6252f6e7a677474'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.512819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-bef4a8fa-2289-40c9-913e-78bac15cf9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acaa6a62e5c442ceb6252f6e7a677474'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.519184 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1361/2719] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:43 2022] DELETE /identity/v3/users/acaa6a62e5c442ceb6252f6e7a677474 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:43.867353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:43.868930 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:43.883338 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892765e-bd29-422e-9a3e-4770ca84e7c1 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:43.939590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:43.940548 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:43.940867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:43.941144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] PATH_INFO: `/v3/projects/a0d37741bf1c46af8391652f6e2b6a27` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:43.942379 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d37741bf1c46af8391652f6e2b6a27)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:43.944279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:43.990570 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d37741bf1c46af8391652f6e2b6a27', 'request_id': 'req-3c4b0948-1383-4fa5-b093-59194ac4b04b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:43.997864 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d37741bf1c46af8391652f6e2b6a27', 'request_id': 'req-3c4b0948-1383-4fa5-b093-59194ac4b04b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:44.004362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d37741bf1c46af8391652f6e2b6a27', 'request_id': 'req-3c4b0948-1383-4fa5-b093-59194ac4b04b'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:44.014118 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] The token cache is being invalidate because project a0d37741bf1c46af8391652f6e2b6a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:44.014432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:44.015048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3c4b0948-1383-4fa5-b093-59194ac4b04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:44.016639 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1359/2720] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:43 2022] DELETE /identity/v3/projects/a0d37741bf1c46af8391652f6e2b6a27 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:44.022395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a9e81-103b-42a7-9d51-92486b86db7e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.022917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a9e81-103b-42a7-9d51-92486b86db7e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.022917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a9e81-103b-42a7-9d51-92486b86db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.040981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-438a9e81-103b-42a7-9d51-92486b86db7e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:44.042309 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-438a9e81-103b-42a7-9d51-92486b86db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:44.102809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1362/2721] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:44.111079 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f39e-b539-4a65-ad48-81c02320223a None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.111403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f39e-b539-4a65-ad48-81c02320223a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.111681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f39e-b539-4a65-ad48-81c02320223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.131098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ee86f39e-b539-4a65-ad48-81c02320223a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:44.132228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ee86f39e-b539-4a65-ad48-81c02320223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:44.141139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1360/2722] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:44.145604 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a9e81-103b-42a7-9d51-92486b86db7e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.156423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a9e81-103b-42a7-9d51-92486b86db7e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.162262 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.162931 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.163212 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.163516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.164250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:44.164584 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.166532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.181922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1363/2723] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:05:44.183152 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f39e-b539-4a65-ad48-81c02320223a None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.192638 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f39e-b539-4a65-ad48-81c02320223a None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.197707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.198364 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.198647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.198920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.199613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.201547 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.229209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1361/2724] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:44 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:44.233432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.243943 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4f382-809e-4024-b849-245aa715ddc4 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.303748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.304415 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.304700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.305000 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.305708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.307615 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.329991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1364/2725] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:44 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:44.334259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.344480 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69e5b-f9d0-40ed-ae00-6d441c646bfa admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.349511 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.350174 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.350456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.350726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.351457 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.353091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.363634 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1362/2726] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:44.367956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.378406 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8dcc-71dc-4a5d-bece-aade60904d45 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.384622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002afbc-bedf-46ba-a717-2da4bfa3643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.385233 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002afbc-bedf-46ba-a717-2da4bfa3643f admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.385533 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002afbc-bedf-46ba-a717-2da4bfa3643f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.385806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002afbc-bedf-46ba-a717-2da4bfa3643f admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.386551 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002afbc-bedf-46ba-a717-2da4bfa3643f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.388130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002afbc-bedf-46ba-a717-2da4bfa3643f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.398338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1365/2727] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:44.402489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.412938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e360df-c323-4df6-be43-74390a215967 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.418665 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.419621 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.420090 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.420372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] PATH_INFO: `/v3/projects/d0182078b1e0413e8b14426cc0b9c8fd/users/235cfd6250314a8297bb8f5620eb478c/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.436620 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0182078b1e0413e8b14426cc0b9c8fd, user_id=235cfd6250314a8297bb8f5620eb478c, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.439348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.453577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1363/2728] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:44 2022] PUT /identity/v3/projects/d0182078b1e0413e8b14426cc0b9c8fd/users/235cfd6250314a8297bb8f5620eb478c/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:44.465301 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017632c-94cc-4370-ab51-8ff6b98587c5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.465687 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017632c-94cc-4370-ab51-8ff6b98587c5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.466246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017632c-94cc-4370-ab51-8ff6b98587c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.497626 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-6017632c-94cc-4370-ab51-8ff6b98587c5 None None] MFA Rules not processed for user `235cfd6250314a8297bb8f5620eb478c`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:44.498814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-6017632c-94cc-4370-ab51-8ff6b98587c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:44.565770 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1366/2729] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:44.572247 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.637502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4c278-dd6b-4c3a-b4a9-3f5f75399aed admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.644455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.645166 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.645449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.645727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.646424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.648381 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.677353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1364/2730] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:44 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:44.681685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017632c-94cc-4370-ab51-8ff6b98587c5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.692522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017632c-94cc-4370-ab51-8ff6b98587c5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.752084 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.752835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.753109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.753385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.754080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.756036 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.778781 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1367/2731] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:44 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:44.783236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.793404 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294824-a90e-4a1e-8d9a-dba86d221dec admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.798168 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.798828 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.799105 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.799383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.800116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.801764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.812068 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1365/2732] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:44.816119 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.826416 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079076-aea3-4ab4-bb66-5542661b9098 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.831966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.832898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.833204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.833474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] PATH_INFO: `/v3/projects/ae6e11d1ac07497bb3263eab8a71fd0d/users/7038fd70d82949a79b8a20a57294d64c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.848132 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6e11d1ac07497bb3263eab8a71fd0d, user_id=7038fd70d82949a79b8a20a57294d64c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.850761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.866679 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1368/2733] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:44 2022] PUT /identity/v3/projects/ae6e11d1ac07497bb3263eab8a71fd0d/users/7038fd70d82949a79b8a20a57294d64c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:44.870702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.881506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9145-fcee-45de-91fc-7ac210fe1117 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.939473 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6162e2f-7503-4231-b63f-ec7243f6008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.940136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162e2f-7503-4231-b63f-ec7243f6008f admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.940420 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162e2f-7503-4231-b63f-ec7243f6008f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.940714 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162e2f-7503-4231-b63f-ec7243f6008f admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.941477 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6162e2f-7503-4231-b63f-ec7243f6008f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.943113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6162e2f-7503-4231-b63f-ec7243f6008f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.953839 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1366/2734] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:44.957312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:44.967591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b22ae1-7773-40f7-a999-f30e68e2313f admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:44.973145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:44.974072 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:44.974354 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:44.974681 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] PATH_INFO: `/v3/projects/ae6e11d1ac07497bb3263eab8a71fd0d/users/7038fd70d82949a79b8a20a57294d64c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:44.977382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6e11d1ac07497bb3263eab8a71fd0d, user_id=7038fd70d82949a79b8a20a57294d64c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:44.980438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:44.991115 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1369/2735] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:44 2022] PUT /identity/v3/projects/ae6e11d1ac07497bb3263eab8a71fd0d/users/7038fd70d82949a79b8a20a57294d64c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:45.002581 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda0e1-b5fd-4ae3-a7fc-5325e8b7bbea None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:45.002874 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda0e1-b5fd-4ae3-a7fc-5325e8b7bbea None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:45.003159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda0e1-b5fd-4ae3-a7fc-5325e8b7bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:45.030792 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-febda0e1-b5fd-4ae3-a7fc-5325e8b7bbea None None] MFA Rules not processed for user `7038fd70d82949a79b8a20a57294d64c`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:45.032006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-febda0e1-b5fd-4ae3-a7fc-5325e8b7bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:45.100158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1367/2736] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:45.117268 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:45.120024 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:45.189429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270035-e3df-46d1-b50b-f59fd97f4faf admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:45.193843 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab129b8-d380-46fa-bc76-8b1ff4882d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:45.194469 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab129b8-d380-46fa-bc76-8b1ff4882d44 service cinder] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:45.194747 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab129b8-d380-46fa-bc76-8b1ff4882d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:45.195015 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab129b8-d380-46fa-bc76-8b1ff4882d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:45.204596 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab129b8-d380-46fa-bc76-8b1ff4882d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:45.206283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab129b8-d380-46fa-bc76-8b1ff4882d44 service cinder] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:45.216946 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1370/2737] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:45.348555 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febda0e1-b5fd-4ae3-a7fc-5325e8b7bbea None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:45.413218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febda0e1-b5fd-4ae3-a7fc-5325e8b7bbea None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:45.418341 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:45.419248 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:45.419532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:45.419772 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] PATH_INFO: `/v3/users/235cfd6250314a8297bb8f5620eb478c` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:45.421144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235cfd6250314a8297bb8f5620eb478c)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:45.423069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:45.477290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235cfd6250314a8297bb8f5620eb478c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:45.477945 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235cfd6250314a8297bb8f5620eb478c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:45.490006 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235cfd6250314a8297bb8f5620eb478c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:45.498003 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235cfd6250314a8297bb8f5620eb478c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:45.504830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235cfd6250314a8297bb8f5620eb478c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:45.510984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1368/2738] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:45 2022] DELETE /identity/v3/users/235cfd6250314a8297bb8f5620eb478c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:45.515249 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:45.515534 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:45.515806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:45.532300 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:45.533640 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:45.591304 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1371/2739] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:45.601532 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:45.603082 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:45.665578 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88c2e-f336-4ae4-a1c3-d21f0abcdfc3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:45.670358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:45.671058 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:45.671342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:45.671619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:45.682242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:45.683764 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:45.694984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1369/2740] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:05:45.970329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:45.972193 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:45.986066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eede8f-5eb2-4c39-82a5-282c8391d683 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:45.990790 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:45.991944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:45.992225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:45.992528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] PATH_INFO: `/v3/projects/d0182078b1e0413e8b14426cc0b9c8fd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:45.993759 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0182078b1e0413e8b14426cc0b9c8fd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:45.995653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:46.044611 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0182078b1e0413e8b14426cc0b9c8fd', 'request_id': 'req-d9dd0925-decb-435b-b527-677c96c844e6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.052897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0182078b1e0413e8b14426cc0b9c8fd', 'request_id': 'req-d9dd0925-decb-435b-b527-677c96c844e6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.059878 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0182078b1e0413e8b14426cc0b9c8fd', 'request_id': 'req-d9dd0925-decb-435b-b527-677c96c844e6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.070546 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] The token cache is being invalidate because project d0182078b1e0413e8b14426cc0b9c8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:46.070831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.071491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-d9dd0925-decb-435b-b527-677c96c844e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.073125 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1372/2741] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:45 2022] DELETE /identity/v3/projects/d0182078b1e0413e8b14426cc0b9c8fd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:46.077230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:46.087522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fde108-5f69-488b-b7d4-338b604e7c78 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:46.144613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:46.145515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.145790 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.146022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] PATH_INFO: `/v3/users/7038fd70d82949a79b8a20a57294d64c` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.147204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7038fd70d82949a79b8a20a57294d64c)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:46.149138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:46.193854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7038fd70d82949a79b8a20a57294d64c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.194501 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7038fd70d82949a79b8a20a57294d64c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.205643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7038fd70d82949a79b8a20a57294d64c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.215695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7038fd70d82949a79b8a20a57294d64c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.223661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7038fd70d82949a79b8a20a57294d64c'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.230342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1370/2742] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:46 2022] DELETE /identity/v3/users/7038fd70d82949a79b8a20a57294d64c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:46.272253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.272758 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.272953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.292421 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:46.293840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:46.349487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1373/2743] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:46.399819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:46.401354 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:46.471522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250c7a0-b7b6-4a0e-8f16-12b85af483fe admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:46.479037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516423f-d803-4a29-8a10-e08af4ef8b27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:46.479777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516423f-d803-4a29-8a10-e08af4ef8b27 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.480160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516423f-d803-4a29-8a10-e08af4ef8b27 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.480463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516423f-d803-4a29-8a10-e08af4ef8b27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.489337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516423f-d803-4a29-8a10-e08af4ef8b27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:46.491485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516423f-d803-4a29-8a10-e08af4ef8b27 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:46.501024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1371/2744] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:05:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:05:46.506760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:46.510105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:46.586013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3cd2d-ffb9-4df2-8c10-b2bd0629d4ee None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:46.591388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:46.592264 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.592652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.592944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] PATH_INFO: `/v3/projects/ae6e11d1ac07497bb3263eab8a71fd0d` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.594401 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6e11d1ac07497bb3263eab8a71fd0d)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:46.596261 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:46.646648 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6e11d1ac07497bb3263eab8a71fd0d', 'request_id': 'req-45865bcd-4ff6-4862-870a-488976fae99d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.655761 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6e11d1ac07497bb3263eab8a71fd0d', 'request_id': 'req-45865bcd-4ff6-4862-870a-488976fae99d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.664347 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6e11d1ac07497bb3263eab8a71fd0d', 'request_id': 'req-45865bcd-4ff6-4862-870a-488976fae99d'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.676031 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] The token cache is being invalidate because project ae6e11d1ac07497bb3263eab8a71fd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:46.676474 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.677291 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-45865bcd-4ff6-4862-870a-488976fae99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:46.683659 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1374/2745] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:46 2022] DELETE /identity/v3/projects/ae6e11d1ac07497bb3263eab8a71fd0d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:46.685489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b126ef-522b-44b2-86ab-a2603d1a41ac None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.685825 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b126ef-522b-44b2-86ab-a2603d1a41ac None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.686332 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b126ef-522b-44b2-86ab-a2603d1a41ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.706410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-41b126ef-522b-44b2-86ab-a2603d1a41ac None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:46.707626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-41b126ef-522b-44b2-86ab-a2603d1a41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:46.772073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1372/2746] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:46.779566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6d76-58a7-4e51-8f2c-a4085e9973fa None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.779841 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6d76-58a7-4e51-8f2c-a4085e9973fa None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.780121 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6d76-58a7-4e51-8f2c-a4085e9973fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.799396 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a63f6d76-58a7-4e51-8f2c-a4085e9973fa None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:46.800699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a63f6d76-58a7-4e51-8f2c-a4085e9973fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:46.809464 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1375/2747] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:46.814678 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b126ef-522b-44b2-86ab-a2603d1a41ac None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:46.826108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b126ef-522b-44b2-86ab-a2603d1a41ac None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:46.833114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:46.834242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.834700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.835301 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.836228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:46.836767 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:46.839342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:46.861371 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1373/2748] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:05:46.861921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6d76-58a7-4e51-8f2c-a4085e9973fa None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:46.872748 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6d76-58a7-4e51-8f2c-a4085e9973fa None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:46.877895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:46.878789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:46.878977 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:46.879391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:46.879994 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:46.881944 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:46.909285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1376/2749] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:46 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:46.914727 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:46.929143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c6073-b5e1-4d10-96b4-cc7eb98e6734 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:46.999462 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.000509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.001002 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.001282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.002520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.004820 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.030880 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1374/2750] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:46 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:47.036508 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.048953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceabca-c751-4b14-a22b-be51f6f8f483 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.054276 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.054992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.055295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.055575 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.056341 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.058057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.070686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1377/2751] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:47.075585 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.090688 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060233a-c9da-407e-8a34-152f5eb45382 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.096230 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1bdc5-f88e-4dd8-99b1-24e72c5799ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.097124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1bdc5-f88e-4dd8-99b1-24e72c5799ad admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.097423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1bdc5-f88e-4dd8-99b1-24e72c5799ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.097724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1bdc5-f88e-4dd8-99b1-24e72c5799ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.098456 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1bdc5-f88e-4dd8-99b1-24e72c5799ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.100184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1bdc5-f88e-4dd8-99b1-24e72c5799ad admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.111234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1375/2752] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:05:47.117379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.130897 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2264-896a-4fb1-9876-05d0d44a962c admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.137281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.138190 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.138528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.138757 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] PATH_INFO: `/v3/projects/2326de5b81e346779e7fdc18b5d8aeb3/users/f08c9ac95b62427e881491530857d04c/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.155642 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2326de5b81e346779e7fdc18b5d8aeb3, user_id=f08c9ac95b62427e881491530857d04c, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.158490 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.186565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1378/2753] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:47 2022] PUT /identity/v3/projects/2326de5b81e346779e7fdc18b5d8aeb3/users/f08c9ac95b62427e881491530857d04c/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:47.189485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd15e-c453-4762-b468-14bf2f07038a None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.189780 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd15e-c453-4762-b468-14bf2f07038a None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.190116 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd15e-c453-4762-b468-14bf2f07038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.227562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-4c2bd15e-c453-4762-b468-14bf2f07038a None None] MFA Rules not processed for user `f08c9ac95b62427e881491530857d04c`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:47.229756 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-4c2bd15e-c453-4762-b468-14bf2f07038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:47.322115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1376/2754] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:47.326686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.413299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fbca0-85d2-462a-8d1f-2ca7c856b3b8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.418432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.419113 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.419399 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.419674 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.420374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.422461 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.461169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1379/2755] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:47 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:47.462400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd15e-c453-4762-b468-14bf2f07038a None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.474733 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd15e-c453-4762-b468-14bf2f07038a None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.536819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.537702 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.538077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.538465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.539276 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.541337 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.564850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1377/2756] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:47 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:47.569740 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.580896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9590-d76b-4c19-9b21-474a40dd0530 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.589227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.589984 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.590273 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.590557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.591298 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.594353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.608012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1380/2757] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:47.609565 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.620577 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e83a-6381-4857-9eed-d4e4d09ee328 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.625476 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.626399 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.626843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.627134 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] PATH_INFO: `/v3/projects/4a5d5855a8b648039daf7e93df8a6f50/users/8c00602d5fc34e30bff1e485aa07f57c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.643433 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5d5855a8b648039daf7e93df8a6f50, user_id=8c00602d5fc34e30bff1e485aa07f57c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.646160 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.670428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1378/2758] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:47 2022] PUT /identity/v3/projects/4a5d5855a8b648039daf7e93df8a6f50/users/8c00602d5fc34e30bff1e485aa07f57c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:47.674397 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.685436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01703b9b-9170-4384-8c46-067c4a174ed5 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.748874 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd678-ca75-443e-b67f-c0d3270c7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.749556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd678-ca75-443e-b67f-c0d3270c7c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.749858 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd678-ca75-443e-b67f-c0d3270c7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.750139 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd678-ca75-443e-b67f-c0d3270c7c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.750993 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd678-ca75-443e-b67f-c0d3270c7c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.752652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd678-ca75-443e-b67f-c0d3270c7c13 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.764716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1381/2759] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:47.768109 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.783330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c25f7-33f0-4797-8ad1-63f0063bf127 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:47.789537 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:47.790735 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.791135 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.791520 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] PATH_INFO: `/v3/projects/4a5d5855a8b648039daf7e93df8a6f50/users/8c00602d5fc34e30bff1e485aa07f57c/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.793834 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5d5855a8b648039daf7e93df8a6f50, user_id=8c00602d5fc34e30bff1e485aa07f57c, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:47.797350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:47.821306 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1379/2760] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:47 2022] PUT /identity/v3/projects/4a5d5855a8b648039daf7e93df8a6f50/users/8c00602d5fc34e30bff1e485aa07f57c/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:47.823433 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8a76-9f23-4ed4-9c92-74b3b22f972f None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:47.823814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8a76-9f23-4ed4-9c92-74b3b22f972f None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:47.824166 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8a76-9f23-4ed4-9c92-74b3b22f972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:47.853014 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-3d6a8a76-9f23-4ed4-9c92-74b3b22f972f None None] MFA Rules not processed for user `8c00602d5fc34e30bff1e485aa07f57c`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:47.854565 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-3d6a8a76-9f23-4ed4-9c92-74b3b22f972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:47.932895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1382/2761] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:47.944604 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:47.946504 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:48.018094 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d845-4c2a-487b-adc3-61c00dce3cf4 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:48.021830 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1af8-e026-440c-9737-9c04f1bf9eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:48.022544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1af8-e026-440c-9737-9c04f1bf9eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:48.022832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1af8-e026-440c-9737-9c04f1bf9eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:48.023110 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1af8-e026-440c-9737-9c04f1bf9eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:48.038561 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1af8-e026-440c-9737-9c04f1bf9eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:48.040201 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1af8-e026-440c-9737-9c04f1bf9eb7 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:48.056051 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1380/2762] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:48.478506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a8a76-9f23-4ed4-9c92-74b3b22f972f None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:48.556589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a8a76-9f23-4ed4-9c92-74b3b22f972f None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:48.564064 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:48.565776 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:48.566317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:48.567032 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] PATH_INFO: `/v3/users/f08c9ac95b62427e881491530857d04c` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:48.568999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08c9ac95b62427e881491530857d04c)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:48.572749 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:48.638431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08c9ac95b62427e881491530857d04c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:48.639096 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08c9ac95b62427e881491530857d04c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:48.647876 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08c9ac95b62427e881491530857d04c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:48.661603 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08c9ac95b62427e881491530857d04c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:48.671722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08c9ac95b62427e881491530857d04c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:48.681914 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1383/2763] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:48 2022] DELETE /identity/v3/users/f08c9ac95b62427e881491530857d04c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:48.687330 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:48.687819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:48.687905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:48.708103 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:48.709400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:48.776730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1381/2764] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:48.789374 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:48.791001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:48.858414 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd547b1-6a55-4787-b083-2b311a86746a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:48.862420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:48.863086 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:48.863372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:48.863653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:48.878893 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:48.880595 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:48.890851 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1384/2765] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:49.217852 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:49.219549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:49.234076 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecf97-cd5d-42d5-8bf4-2efd934e1c6d None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:49.239423 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:49.240465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:49.240843 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:49.241562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] PATH_INFO: `/v3/projects/2326de5b81e346779e7fdc18b5d8aeb3` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:49.242915 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2326de5b81e346779e7fdc18b5d8aeb3)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:49.245207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:49.296254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2326de5b81e346779e7fdc18b5d8aeb3', 'request_id': 'req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.307425 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2326de5b81e346779e7fdc18b5d8aeb3', 'request_id': 'req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.315661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2326de5b81e346779e7fdc18b5d8aeb3', 'request_id': 'req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.326801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] The token cache is being invalidate because project 2326de5b81e346779e7fdc18b5d8aeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:49.327177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.327906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.329805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1382/2766] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:49 2022] DELETE /identity/v3/projects/2326de5b81e346779e7fdc18b5d8aeb3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:49.333697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:49.343958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc17c6-15bb-4048-9852-ff777126ed01 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:49.460282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:49.461482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:49.461920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:49.462573 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] PATH_INFO: `/v3/users/8c00602d5fc34e30bff1e485aa07f57c` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:49.464167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c00602d5fc34e30bff1e485aa07f57c)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:49.467093 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:49.548020 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c00602d5fc34e30bff1e485aa07f57c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.549509 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c00602d5fc34e30bff1e485aa07f57c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.560034 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c00602d5fc34e30bff1e485aa07f57c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.574712 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c00602d5fc34e30bff1e485aa07f57c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.581825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-de76b5b4-e37e-45a9-a585-ca4f64cca98b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c00602d5fc34e30bff1e485aa07f57c'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:49.587999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1385/2767] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:49 2022] DELETE /identity/v3/users/8c00602d5fc34e30bff1e485aa07f57c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:49.968146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:49.969989 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:49.992025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c763e-bdd2-4601-9567-828d5c3ffaaa admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.087503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.088377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.088661 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.088977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] PATH_INFO: `/v3/projects/4a5d5855a8b648039daf7e93df8a6f50` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.090210 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5d5855a8b648039daf7e93df8a6f50)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.092138 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.145991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5d5855a8b648039daf7e93df8a6f50', 'request_id': 'req-835a649f-0831-456b-abc5-cbf9382f624f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:50.155083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5d5855a8b648039daf7e93df8a6f50', 'request_id': 'req-835a649f-0831-456b-abc5-cbf9382f624f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:50.161860 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5d5855a8b648039daf7e93df8a6f50', 'request_id': 'req-835a649f-0831-456b-abc5-cbf9382f624f'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:50.173826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] The token cache is being invalidate because project 4a5d5855a8b648039daf7e93df8a6f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:50.174159 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:50.174782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-835a649f-0831-456b-abc5-cbf9382f624f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:50.179754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1383/2768] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:49 2022] DELETE /identity/v3/projects/4a5d5855a8b648039daf7e93df8a6f50 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:50.181506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3c66f-87a5-4940-8fcc-f98df22d0e7e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.181801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3c66f-87a5-4940-8fcc-f98df22d0e7e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.182104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3c66f-87a5-4940-8fcc-f98df22d0e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.200920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-2ef3c66f-87a5-4940-8fcc-f98df22d0e7e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:50.202325 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-2ef3c66f-87a5-4940-8fcc-f98df22d0e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:50.266181 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1386/2769] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:50.273966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f7039-54d7-4d28-8f7e-cc6bbdf48209 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.274254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f7039-54d7-4d28-8f7e-cc6bbdf48209 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.274530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f7039-54d7-4d28-8f7e-cc6bbdf48209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.302522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-659f7039-54d7-4d28-8f7e-cc6bbdf48209 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:50.303873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-659f7039-54d7-4d28-8f7e-cc6bbdf48209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:50.312642 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1384/2770] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:50.317250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3c66f-87a5-4940-8fcc-f98df22d0e7e None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:50.327419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3c66f-87a5-4940-8fcc-f98df22d0e7e None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.332379 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.333078 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.333366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.333644 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.334392 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:50.334702 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.336288 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.352174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1387/2771] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:05:50.353300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f7039-54d7-4d28-8f7e-cc6bbdf48209 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:50.362777 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f7039-54d7-4d28-8f7e-cc6bbdf48209 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.368556 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.369275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.369573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.369850 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.370563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.372484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.401136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1385/2772] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:50.407091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:50.418146 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98e2db-73c8-4e46-9532-b1b490ee0475 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.481381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.482167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.482522 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.482869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.483689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.486134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.510410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1388/2773] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:50 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:50.514770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:50.526204 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e30380-62a3-42fe-b7e8-46c4231b46c6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.531213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.532530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.532890 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.533172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.533916 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.535562 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.554016 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1386/2774] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:50.555721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:50.567226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2c1d4-583a-4d02-b5ba-7798406d221b admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.574572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee397ec9-444c-4da7-85dc-c2d0f3478027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.575438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397ec9-444c-4da7-85dc-c2d0f3478027 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.575966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397ec9-444c-4da7-85dc-c2d0f3478027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.576539 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee397ec9-444c-4da7-85dc-c2d0f3478027 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.577381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee397ec9-444c-4da7-85dc-c2d0f3478027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.579529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee397ec9-444c-4da7-85dc-c2d0f3478027 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.604230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1389/2775] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:05:50.608667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:50.619805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bcb4-f208-439c-963b-093c39e3771a admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.625037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.626146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.626355 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.626649 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] PATH_INFO: `/v3/projects/7264c223204645fda8bf7d28a36821f6/users/06836b3579e84287992709e9ae321b3a/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.641738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7264c223204645fda8bf7d28a36821f6, user_id=06836b3579e84287992709e9ae321b3a, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.644469 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.659367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1387/2776] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:50 2022] PUT /identity/v3/projects/7264c223204645fda8bf7d28a36821f6/users/06836b3579e84287992709e9ae321b3a/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:50.670978 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.671583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.672169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.700536 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] MFA Rules not processed for user `06836b3579e84287992709e9ae321b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:50.701842 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:50.791753 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1390/2777] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:50.806122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:50.808169 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:50.882232 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02474d-6785-4193-9a9f-6908fb67fc7d admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:50.886736 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:50.887463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:50.887752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:50.888042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:50.898181 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:50.899779 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:50.911447 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1388/2778] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:53.699487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:53.701466 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:53.770558 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13905-ed8d-4e6d-a164-136160304016 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:53.775803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82398ae0-0ad8-485b-9e14-62f39189a103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:53.776822 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398ae0-0ad8-485b-9e14-62f39189a103 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:53.777620 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398ae0-0ad8-485b-9e14-62f39189a103 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:53.778099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398ae0-0ad8-485b-9e14-62f39189a103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:53.780722 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-82398ae0-0ad8-485b-9e14-62f39189a103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:53.859706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82398ae0-0ad8-485b-9e14-62f39189a103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:53.861562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82398ae0-0ad8-485b-9e14-62f39189a103 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:53.878163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1391/2779] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:54.181366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:54.249018 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d26f-4fac-4386-adef-2d8c88b948a9 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:54.254114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:54.255307 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:54.255613 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:54.255985 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] PATH_INFO: `/v3/users/06836b3579e84287992709e9ae321b3a` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:54.257510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06836b3579e84287992709e9ae321b3a)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:54.259667 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:54.318949 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06836b3579e84287992709e9ae321b3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:54.319743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06836b3579e84287992709e9ae321b3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:54.333513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06836b3579e84287992709e9ae321b3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:54.347466 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06836b3579e84287992709e9ae321b3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:54.355658 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06836b3579e84287992709e9ae321b3a'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:54.365483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1389/2780] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:05:54 2022] DELETE /identity/v3/users/06836b3579e84287992709e9ae321b3a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:54.367557 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:54.367895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:54.368182 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:54.399040 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:54.400282 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:54.502225 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1392/2781] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:54.512499 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:54.514010 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:54.584007 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ceb94-752e-4f67-a556-8563acebd6c4 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:54.588043 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c412-d221-45d2-baab-f8f499874995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:54.589223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c412-d221-45d2-baab-f8f499874995 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:54.589223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c412-d221-45d2-baab-f8f499874995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:54.589529 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c412-d221-45d2-baab-f8f499874995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:54.600041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637c412-d221-45d2-baab-f8f499874995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:54.601630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637c412-d221-45d2-baab-f8f499874995 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:54.613601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1390/2782] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:05:54.956254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:54.958493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:54.973223 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb34896-90fc-4318-bf27-f59ba2ae9fc3 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:54.981353 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:54.982963 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:54.983473 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:54.983999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] PATH_INFO: `/v3/projects/7264c223204645fda8bf7d28a36821f6` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:54.986420 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7264c223204645fda8bf7d28a36821f6)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:54.988816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.060585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7264c223204645fda8bf7d28a36821f6', 'request_id': 'req-a707cb3b-b456-4a35-8acb-7f19591091c4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:55.074053 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7264c223204645fda8bf7d28a36821f6', 'request_id': 'req-a707cb3b-b456-4a35-8acb-7f19591091c4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:55.093837 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7264c223204645fda8bf7d28a36821f6', 'request_id': 'req-a707cb3b-b456-4a35-8acb-7f19591091c4'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:55.110340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] The token cache is being invalidate because project 7264c223204645fda8bf7d28a36821f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:05:55.110912 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:55.112047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-a707cb3b-b456-4a35-8acb-7f19591091c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:05:55.114173 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1393/2783] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:05:54 2022] DELETE /identity/v3/projects/7264c223204645fda8bf7d28a36821f6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:05:55.120722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4b208-dfd7-47d5-8a02-00a0a99576ba None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.121023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4b208-dfd7-47d5-8a02-00a0a99576ba None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.121365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4b208-dfd7-47d5-8a02-00a0a99576ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.149692 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-98f4b208-dfd7-47d5-8a02-00a0a99576ba None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:55.151270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-98f4b208-dfd7-47d5-8a02-00a0a99576ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:55.232822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1391/2784] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:55.240192 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea768-f29d-46da-b710-e14c8ac6248a None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.240833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea768-f29d-46da-b710-e14c8ac6248a None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.241697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea768-f29d-46da-b710-e14c8ac6248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.262869 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-c5bea768-f29d-46da-b710-e14c8ac6248a None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:55.264128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c5bea768-f29d-46da-b710-e14c8ac6248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:55.282715 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1394/2785] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:05:55.284870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4b208-dfd7-47d5-8a02-00a0a99576ba None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:55.305563 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4b208-dfd7-47d5-8a02-00a0a99576ba None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:55.311165 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:55.312128 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.312904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.312904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.313503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:05:55.314077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:55.315684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.332910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1392/2786] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:05:55.337126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea768-f29d-46da-b710-e14c8ac6248a None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:55.347204 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea768-f29d-46da-b710-e14c8ac6248a None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:55.353372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:55.354038 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.354314 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.354589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.355285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:55.357337 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.389566 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1395/2787] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:05:55 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:05:55.390312 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:55.408905 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b76dda-74c5-4626-ba92-4e6c50d7cfa3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:55.498458 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:55.500087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.500899 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.501195 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.502938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:55.505365 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.536891 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1393/2788] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:05:55 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:05:55.540835 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:55.552731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8e52-cf04-4f09-ba76-bf72ce04c456 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:55.558306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:55.559285 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.561042 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.561378 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.567369 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:55.569732 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.587956 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1396/2789] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:55.595648 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:55.608643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e631a1-a34e-450e-9601-7a379458f60e admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:55.618773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101af97-f358-4bac-87a2-bed1addcd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:55.620541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101af97-f358-4bac-87a2-bed1addcd959 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.620944 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101af97-f358-4bac-87a2-bed1addcd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.621333 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101af97-f358-4bac-87a2-bed1addcd959 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.622291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101af97-f358-4bac-87a2-bed1addcd959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:55.624461 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101af97-f358-4bac-87a2-bed1addcd959 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.645146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1394/2790] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:05:55.646167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:55.664516 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812d3e-dfb5-4a02-8a41-f4792a6b4771 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:55.672437 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:55.673846 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.674359 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.674845 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] PATH_INFO: `/v3/projects/9eb01bc12113463ab0f3d9d80b011053/users/e2e0c60d84764101a21c82eb64c565ce/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.702599 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb01bc12113463ab0f3d9d80b011053, user_id=e2e0c60d84764101a21c82eb64c565ce, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:55.705813 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.733066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1397/2791] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:05:55 2022] PUT /identity/v3/projects/9eb01bc12113463ab0f3d9d80b011053/users/e2e0c60d84764101a21c82eb64c565ce/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:05:55.738132 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b535-ffeb-4a29-ba27-84196391100b None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.738350 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b535-ffeb-4a29-ba27-84196391100b None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.738799 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b535-ffeb-4a29-ba27-84196391100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.763156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-c061b535-ffeb-4a29-ba27-84196391100b None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:05:55.764465 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c061b535-ffeb-4a29-ba27-84196391100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:55.849519 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1395/2792] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:05:55.863134 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:05:55.866607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:05:55.952459 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a47bea-acec-4dfb-a087-d708dedb3965 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:05:55.956290 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:05:55.957081 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:05:55.957486 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:05:55.957856 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:05:55.967567 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:05:55.972266 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:05:55.986250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1398/2793] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:06:01.714971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475147ac-f9db-4628-8ac3-1f58bdaee859 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:01.715484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475147ac-f9db-4628-8ac3-1f58bdaee859 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:01.716769 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475147ac-f9db-4628-8ac3-1f58bdaee859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:01.765909 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-475147ac-f9db-4628-8ac3-1f58bdaee859 None None] MFA Rules not processed for user `e2e0c60d84764101a21c82eb64c565ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:01.767218 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-475147ac-f9db-4628-8ac3-1f58bdaee859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:01.873489 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1396/2794] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:01.878526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:01.898890 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbe7ba-0962-462a-8b6b-2656bf325ba3 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:01.905287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:01.906005 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:01.906289 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:01.906562 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:01.907332 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:01.909348 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:01.954691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1399/2795] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:06:01 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:01.959173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475147ac-f9db-4628-8ac3-1f58bdaee859 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:01.979455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475147ac-f9db-4628-8ac3-1f58bdaee859 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:02.067776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:02.069026 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:02.069342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:02.069718 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:02.070754 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:02.073291 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:02.106554 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:02.108832 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1397/2796] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:06:01 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:06:02.122127 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5194c0-1fdd-4d41-ad69-16c5b3b89bbf admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:02.127825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:02.128954 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:02.129430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:02.129953 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:02.130886 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:02.132929 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:02.146398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1400/2797] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:06:02.150910 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:02.162101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024514-21af-4d3d-b92a-b70cc1d8378b admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:02.167254 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:02.168154 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:02.168438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:02.168755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] PATH_INFO: `/v3/projects/98c15f6eaedb4465b6711e1d2735fa8a/users/e2a8a7c8abbc47a98c580cb1540e68c3/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:02.187171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c15f6eaedb4465b6711e1d2735fa8a, user_id=e2a8a7c8abbc47a98c580cb1540e68c3, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:02.191162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:02.208030 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1398/2798] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:06:02 2022] PUT /identity/v3/projects/98c15f6eaedb4465b6711e1d2735fa8a/users/e2a8a7c8abbc47a98c580cb1540e68c3/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:02.213801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:02.226999 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81518905-06ae-4cda-868f-42f04b44fb42 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:02.297313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb698a-4a84-4d77-9481-194f0ecdcaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:02.298328 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb698a-4a84-4d77-9481-194f0ecdcaed admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:02.298783 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb698a-4a84-4d77-9481-194f0ecdcaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:02.299270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb698a-4a84-4d77-9481-194f0ecdcaed admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:02.300350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb698a-4a84-4d77-9481-194f0ecdcaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:02.302046 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb698a-4a84-4d77-9481-194f0ecdcaed admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:02.315321 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1401/2799] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:06:02.319459 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:02.330659 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc439d9-eb34-4750-a3a9-64244c209935 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:02.336752 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:02.337782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:02.338081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:02.338403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] PATH_INFO: `/v3/projects/98c15f6eaedb4465b6711e1d2735fa8a/users/e2a8a7c8abbc47a98c580cb1540e68c3/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:02.340614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c15f6eaedb4465b6711e1d2735fa8a, user_id=e2a8a7c8abbc47a98c580cb1540e68c3, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:02.343913 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:02.359073 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1399/2800] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:06:02 2022] PUT /identity/v3/projects/98c15f6eaedb4465b6711e1d2735fa8a/users/e2a8a7c8abbc47a98c580cb1540e68c3/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:06:05.227235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6864fa-a1e5-48bc-83d2-87efce5f9222 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:05.227724 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6864fa-a1e5-48bc-83d2-87efce5f9222 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:05.227991 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6864fa-a1e5-48bc-83d2-87efce5f9222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:05.267915 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-af6864fa-a1e5-48bc-83d2-87efce5f9222 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:05.269243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-af6864fa-a1e5-48bc-83d2-87efce5f9222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:05.404860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1402/2801] 10.222.0.52 () {58 vars in 967 bytes} [Tue May 10 19:06:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:06:05.417778 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:05.420031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:05.562436 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4cdcc-a972-4d5a-935b-443c07d25e27 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:05.582448 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:05.583137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:05.583429 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:05.583709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:05.615589 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:05.617584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:05.640994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1400/2802] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:06:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:06:07.274728 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd229d-62d0-489e-9bc4-e2ac40980a74 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:07.275274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd229d-62d0-489e-9bc4-e2ac40980a74 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:07.275274 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd229d-62d0-489e-9bc4-e2ac40980a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:07.304012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-e6fd229d-62d0-489e-9bc4-e2ac40980a74 None None] MFA Rules not processed for user `e2a8a7c8abbc47a98c580cb1540e68c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:07.305734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-e6fd229d-62d0-489e-9bc4-e2ac40980a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:07.379052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1403/2803] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:07.395243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:07.397205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:07.467490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e8c97-e17b-4a54-8088-5a60d019d781 service swift] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:07.472725 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:07.473774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:07.474215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:07.474668 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:07.540715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:07.542682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:07.555625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1401/2804] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:06:07.677101 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:07.678211 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:07.678700 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:07.700833 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:07.702253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:07.710362 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1404/2805] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:06:07.726627 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:07.743036 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c37484-dbcf-4119-b020-1dae614bdc03 service glance] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:07.749260 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:07.749994 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:07.750342 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:07.750673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:07.762485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:07.767108 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:07.775574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1402/2806] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:06:07.859338 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:07.864366 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:07.941188 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c428ea-f2ac-486a-85c9-d896beb51ac8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:07.952068 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:07.952987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:07.953335 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:07.953686 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] PATH_INFO: `/v3/users/c5a18761923349d6bbc628ec46fa0764` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:07.955019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a18761923349d6bbc628ec46fa0764)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:07.958431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:08.027992 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a18761923349d6bbc628ec46fa0764'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.028945 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a18761923349d6bbc628ec46fa0764'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.037689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a18761923349d6bbc628ec46fa0764'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.053968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a18761923349d6bbc628ec46fa0764'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.064887 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-c4a526d8-7edb-4ef7-930a-217c1cef1755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a18761923349d6bbc628ec46fa0764'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.071051 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1405/2807] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:06:07 2022] DELETE /identity/v3/users/c5a18761923349d6bbc628ec46fa0764 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:08.267478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:08.278400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9694eb-9c9b-45c2-ac08-d30c3efcda56 service swift] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:08.363083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:08.364387 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.364770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.365106 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] PATH_INFO: `/v3/projects/8a803c29217e4388a684686173489d99` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.366695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a803c29217e4388a684686173489d99)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:08.368593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:08.436641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a803c29217e4388a684686173489d99', 'request_id': 'req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.453544 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a803c29217e4388a684686173489d99', 'request_id': 'req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.461831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a803c29217e4388a684686173489d99', 'request_id': 'req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.475588 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] The token cache is being invalidate because project 8a803c29217e4388a684686173489d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:06:08.476000 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.477074 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-c6e6d6d2-01b1-4bd9-b59c-5d6f194245c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:08.479057 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1403/2808] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:06:08 2022] DELETE /identity/v3/projects/8a803c29217e4388a684686173489d99 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:08.484706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7536cc-27a3-4d9f-9458-923bf2432ed2 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.484706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7536cc-27a3-4d9f-9458-923bf2432ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.485254 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7536cc-27a3-4d9f-9458-923bf2432ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.507514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-0f7536cc-27a3-4d9f-9458-923bf2432ed2 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:08.508898 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0f7536cc-27a3-4d9f-9458-923bf2432ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:08.581627 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1406/2809] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:06:08.589765 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff03b-cba9-4859-b509-82e473145843 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.590139 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff03b-cba9-4859-b509-82e473145843 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.590483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff03b-cba9-4859-b509-82e473145843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.618795 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-506ff03b-cba9-4859-b509-82e473145843 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:08.620113 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-506ff03b-cba9-4859-b509-82e473145843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:08.638763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1404/2810] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:08.643142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7536cc-27a3-4d9f-9458-923bf2432ed2 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:08.655336 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7536cc-27a3-4d9f-9458-923bf2432ed2 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:08.663168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:08.663965 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.664350 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.664815 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.665699 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:08.666110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:08.668099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:08.708865 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1407/2811] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:06:08.713173 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff03b-cba9-4859-b509-82e473145843 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:08.725760 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff03b-cba9-4859-b509-82e473145843 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:08.731176 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:08.731844 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.732125 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.732394 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.733122 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:08.736178 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:08.797728 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1405/2812] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:06:08 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:08.801479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:08.817154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b607298-4fe5-4aad-a3b4-d99c10b24977 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:08.898847 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:08.899682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.899971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.900247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.901043 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:08.905250 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:08.934795 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1408/2813] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:06:08 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:08.938599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:08.951150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69a80f-d761-47e2-ade2-1be4e6eacbb0 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:08.956084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:08.956805 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.957085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:08.957358 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:08.958263 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:08.959759 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:08.971882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1406/2814] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:06:08.975968 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:08.993054 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035ff4d-2ebf-4ae1-8d89-ebea73017ce0 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:08.998922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1805030-f813-4ac4-a74d-96a998c8b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:08.999609 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1805030-f813-4ac4-a74d-96a998c8b770 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:08.999895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1805030-f813-4ac4-a74d-96a998c8b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:09.000174 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1805030-f813-4ac4-a74d-96a998c8b770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:09.001253 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1805030-f813-4ac4-a74d-96a998c8b770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:09.003744 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1805030-f813-4ac4-a74d-96a998c8b770 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:09.018772 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1409/2815] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:06:09.023485 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:09.040323 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd448f-dc74-4d25-abdf-d6171521c2da admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:09.046039 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:09.047098 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:09.047496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:09.047951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] PATH_INFO: `/v3/projects/5b3f5ee7f7bf4200908618f32f669d49/users/39ae4ae15b9141b7900d7da2782aeae6/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:09.074686 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3f5ee7f7bf4200908618f32f669d49, user_id=39ae4ae15b9141b7900d7da2782aeae6, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:09.078514 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:09.112530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1407/2816] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:06:09 2022] PUT /identity/v3/projects/5b3f5ee7f7bf4200908618f32f669d49/users/39ae4ae15b9141b7900d7da2782aeae6/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:09.113867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f959-1ada-4dee-8294-1cd05f2e1b83 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:09.113867 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f959-1ada-4dee-8294-1cd05f2e1b83 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:09.114090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f959-1ada-4dee-8294-1cd05f2e1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:09.143989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5ec4f959-1ada-4dee-8294-1cd05f2e1b83 None None] MFA Rules not processed for user `39ae4ae15b9141b7900d7da2782aeae6`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:09.145398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5ec4f959-1ada-4dee-8294-1cd05f2e1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:09.248352 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1410/2817] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:09.262375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:09.267525 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:09.349713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c1da-b36f-406b-97ec-1ab7a62fb0d3 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:09.356389 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8650bbea186e427fac890eabe18ba153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:09.357088 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:09.357375 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:09.357652 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:09.377366 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:09.378738 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:09.390521 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1408/2818] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:06:17.321391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db480e2-3b52-4545-bf54-d0e48591474b None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:17.321921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db480e2-3b52-4545-bf54-d0e48591474b None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:17.321921 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db480e2-3b52-4545-bf54-d0e48591474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:17.341258 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-5db480e2-3b52-4545-bf54-d0e48591474b None None] MFA Rules not processed for user `e2e0c60d84764101a21c82eb64c565ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:17.342481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-5db480e2-3b52-4545-bf54-d0e48591474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:17.400788 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1411/2819] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:18.475280 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:18.476704 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:18.547107 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d79b-843c-48b3-977a-490f2f5ba1cf service glance] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:18.552964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:18.553631 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:18.553911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:18.554182 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:18.556121 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:18.568609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:18.570442 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:18.581062 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1409/2820] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:06:19.680579 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4336-dfa1-459e-bb5a-dc7cfb9827cb None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:19.681102 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4336-dfa1-459e-bb5a-dc7cfb9827cb None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:19.681222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4336-dfa1-459e-bb5a-dc7cfb9827cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:19.699145 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-637c4336-dfa1-459e-bb5a-dc7cfb9827cb None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:19.700560 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-637c4336-dfa1-459e-bb5a-dc7cfb9827cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:19.765947 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1412/2821] 10.222.0.52 () {58 vars in 1009 bytes} [Tue May 10 19:06:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:19.778969 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:19.780543 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:19.845918 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906d1c0-b3c3-41d4-9d62-4ff9b50a5724 service placement] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:19.850837 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c2d93-d4aa-4592-a656-0d09ca526bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:19.851488 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2d93-d4aa-4592-a656-0d09ca526bb1 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:19.851770 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2d93-d4aa-4592-a656-0d09ca526bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:19.852042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2d93-d4aa-4592-a656-0d09ca526bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:19.860085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c2d93-d4aa-4592-a656-0d09ca526bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:19.861695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c2d93-d4aa-4592-a656-0d09ca526bb1 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:19.869815 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1410/2822] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:06:36.418734 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4336-dfa1-459e-bb5a-dc7cfb9827cb None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:36.497281 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4336-dfa1-459e-bb5a-dc7cfb9827cb None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:36.503130 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:36.504012 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:36.504295 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:36.504570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] PATH_INFO: `/v3/users/39ae4ae15b9141b7900d7da2782aeae6` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:36.505948 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ae4ae15b9141b7900d7da2782aeae6)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:36.507895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:36.556156 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ae4ae15b9141b7900d7da2782aeae6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:36.556825 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ae4ae15b9141b7900d7da2782aeae6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:36.565104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ae4ae15b9141b7900d7da2782aeae6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:36.578151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ae4ae15b9141b7900d7da2782aeae6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:36.585375 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ae4ae15b9141b7900d7da2782aeae6'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:36.591260 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1413/2823] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:06:36 2022] DELETE /identity/v3/users/39ae4ae15b9141b7900d7da2782aeae6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:36.596137 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:36.596724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:36.596724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:36.619124 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:36.620991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:36.690463 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1411/2824] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:36.700829 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:36.702504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:36.764277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98381-b25b-42ce-80cb-055024c3b52a admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:36.768966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547259-c239-4e54-b386-822b6a182775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:36.769643 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547259-c239-4e54-b386-822b6a182775 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:36.769924 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547259-c239-4e54-b386-822b6a182775 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:36.770196 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547259-c239-4e54-b386-822b6a182775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:36.781628 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547259-c239-4e54-b386-822b6a182775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:36.783061 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547259-c239-4e54-b386-822b6a182775 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:36.793521 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1414/2825] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:06:37.062297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.063953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:37.076377 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4acf4b-b628-481e-aa1f-42c5e952fb41 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.081836 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.082709 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.082995 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.083270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] PATH_INFO: `/v3/projects/5b3f5ee7f7bf4200908618f32f669d49` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.084590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3f5ee7f7bf4200908618f32f669d49)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.086595 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.138732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3f5ee7f7bf4200908618f32f669d49', 'request_id': 'req-f021d696-111a-486a-bcb1-aa668fe76bd1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:37.149203 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3f5ee7f7bf4200908618f32f669d49', 'request_id': 'req-f021d696-111a-486a-bcb1-aa668fe76bd1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:37.156040 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3f5ee7f7bf4200908618f32f669d49', 'request_id': 'req-f021d696-111a-486a-bcb1-aa668fe76bd1'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:37.166406 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] The token cache is being invalidate because project 5b3f5ee7f7bf4200908618f32f669d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:06:37.166691 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:37.167343 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-f021d696-111a-486a-bcb1-aa668fe76bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:06:37.168965 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1412/2826] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:06:37 2022] DELETE /identity/v3/projects/5b3f5ee7f7bf4200908618f32f669d49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:06:37.174680 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1274e-d5dc-43fd-b189-b6da42613548 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.175066 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1274e-d5dc-43fd-b189-b6da42613548 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.175432 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1274e-d5dc-43fd-b189-b6da42613548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.203706 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-54d1274e-d5dc-43fd-b189-b6da42613548 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:37.205057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-54d1274e-d5dc-43fd-b189-b6da42613548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:37.270463 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1415/2827] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:06:37.278794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a895-a1c1-474c-af00-ce4dd301df23 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.279084 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a895-a1c1-474c-af00-ce4dd301df23 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.279362 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a895-a1c1-474c-af00-ce4dd301df23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.298901 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a1d5a895-a1c1-474c-af00-ce4dd301df23 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:37.300100 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a1d5a895-a1c1-474c-af00-ce4dd301df23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:37.309584 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1413/2828] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:37.313860 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1274e-d5dc-43fd-b189-b6da42613548 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.323694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1274e-d5dc-43fd-b189-b6da42613548 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.328419 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.329136 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.329411 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.329682 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.330410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79971) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:06:37.330710 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.332307 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.343812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1416/2829] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:06:37.348170 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a895-a1c1-474c-af00-ce4dd301df23 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.357956 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a895-a1c1-474c-af00-ce4dd301df23 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.362997 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.363669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.363929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.364198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.365259 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.367172 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.393707 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1414/2830] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:06:37 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:06:37.397824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.407552 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385180f-0c05-4f17-9e07-3bb877c335b4 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.465242 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.466226 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.466513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.466789 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] PATH_INFO: `/v3/users` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.467506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.469532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.492168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1417/2831] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:06:37 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:06:37.496929 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.507980 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26492-712c-4f26-88fd-4f145dffb9c5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.512934 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.513607 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.513885 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.514158 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.514919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.516631 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.531101 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1415/2832] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:06:37.532385 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.542154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f8b3b-ff51-4185-a6d6-5986108de530 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.546980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309205d4-a412-48f3-80b8-6fb0d91c249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.547685 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309205d4-a412-48f3-80b8-6fb0d91c249e admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.547965 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309205d4-a412-48f3-80b8-6fb0d91c249e admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.548237 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309205d4-a412-48f3-80b8-6fb0d91c249e admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.549041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309205d4-a412-48f3-80b8-6fb0d91c249e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.550637 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309205d4-a412-48f3-80b8-6fb0d91c249e admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.560529 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1418/2833] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:06:37.565022 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.575503 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5b11-192f-4d5e-86c4-45c081a84969 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.581566 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.582509 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.582794 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.583069 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] PATH_INFO: `/v3/projects/d3ac7f1015e34e5599e7880a030cc0a4/users/b006c84e982f47b98737736511b88d57/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.599515 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ac7f1015e34e5599e7880a030cc0a4, user_id=b006c84e982f47b98737736511b88d57, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.602239 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.616845 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1416/2834] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:06:37 2022] PUT /identity/v3/projects/d3ac7f1015e34e5599e7880a030cc0a4/users/b006c84e982f47b98737736511b88d57/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:06:37.622122 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db209c-5397-479f-ac8e-a02fec1d8df5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.622587 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db209c-5397-479f-ac8e-a02fec1d8df5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.622873 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db209c-5397-479f-ac8e-a02fec1d8df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.644593 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-d9db209c-5397-479f-ac8e-a02fec1d8df5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:37.646549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-d9db209c-5397-479f-ac8e-a02fec1d8df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:37.708176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1419/2835] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:06:37.718647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:37.720853 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:37.780717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cad237-b2b1-4415-8484-c93f9892afc9 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:37.786318 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:37.786984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:37.787270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:37.787542 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:37.798854 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:37.800309 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:37.810144 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1417/2836] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:06:38.486684 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f36c-2bce-49dc-88b4-24c5f2897291 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.487287 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f36c-2bce-49dc-88b4-24c5f2897291 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.487388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f36c-2bce-49dc-88b4-24c5f2897291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.515057 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-8b83f36c-2bce-49dc-88b4-24c5f2897291 None None] MFA Rules not processed for user `b006c84e982f47b98737736511b88d57`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:38.516388 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-8b83f36c-2bce-49dc-88b4-24c5f2897291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:38.600430 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1420/2837] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:38.601650 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:38.603081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:38.671012 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dc69a-86f0-4066-a9cb-8c483b5f571f service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:38.674690 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:38.675336 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:38.675612 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:38.675882 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:38.684171 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:38.685619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:38.694421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1418/2838] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:06:40.042259 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:40.042823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:40.042823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:40.063502 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] MFA Rules not processed for user `b006c84e982f47b98737736511b88d57`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:06:40.064872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:40.072512 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1421/2839] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:06:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:06:48.884376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:48.895009 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3a94-5d01-4db9-a330-c366690b41ce service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:48.899664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69686c5-3222-49a1-a8b1-f98981237101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:48.900421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69686c5-3222-49a1-a8b1-f98981237101 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:48.900803 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69686c5-3222-49a1-a8b1-f98981237101 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:48.901148 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69686c5-3222-49a1-a8b1-f98981237101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:48.903226 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-d69686c5-3222-49a1-a8b1-f98981237101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:48.969328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69686c5-3222-49a1-a8b1-f98981237101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:48.970732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69686c5-3222-49a1-a8b1-f98981237101 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:48.981328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1419/2840] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:06:52.556531 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:06:52.558818 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:52.661312 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee357b95-4fa2-4e17-b588-f3eede7d51e8 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:06:52.673884 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:06:52.674612 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:06:52.675142 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:06:52.675556 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:06:52.677793 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:06:52.690987 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:06:52.692958 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:06:52.705550 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1422/2841] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:06:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:07:43.257775 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:07:43.258372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:07:43.258372 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:07:43.279348 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] MFA Rules not processed for user `b006c84e982f47b98737736511b88d57`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:07:43.280549 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:07:43.288541 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1420/2842] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:07:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:08:13.163631 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:13.173920 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42751789-6cb6-4069-a8a9-2cb4a85f21f7 service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.180479 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f7bc5-cd46-4ab9-96e8-b039f584cfc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.181161 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f7bc5-cd46-4ab9-96e8-b039f584cfc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.181585 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f7bc5-cd46-4ab9-96e8-b039f584cfc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.181828 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f7bc5-cd46-4ab9-96e8-b039f584cfc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.183933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:13.184504 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-4b0f7bc5-cd46-4ab9-96e8-b039f584cfc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:13.185421 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:13.199582 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4d80c-38d8-4523-aefe-2a695f797423 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:13.200526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f7bc5-cd46-4ab9-96e8-b039f584cfc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.202035 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f7bc5-cd46-4ab9-96e8-b039f584cfc5 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.205424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:13.206223 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:13.206506 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:13.206988 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:13.209614 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:13.214106 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1423/2843] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:08:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:08:13.224870 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:13.226568 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:13.241749 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1421/2844] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:08:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:08:24.936198 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eb8e-cd83-4511-8718-ca3e8cf21a07 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:24.936745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eb8e-cd83-4511-8718-ca3e8cf21a07 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:24.936745 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eb8e-cd83-4511-8718-ca3e8cf21a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:24.954428 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-cc20eb8e-cd83-4511-8718-ca3e8cf21a07 None None] MFA Rules not processed for user `d1455f40069444ffba21c84a8eab7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:24.955597 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-cc20eb8e-cd83-4511-8718-ca3e8cf21a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:25.009245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1424/2845] 10.222.0.52 () {58 vars in 967 bytes} [Tue May 10 19:08:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:08:25.050198 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:25.051722 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:25.120449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b14f3-8b2f-4661-a6e6-79709429e854 service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:25.125449 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e110bec628462e8699b8681daf2d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:25.126083 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:25.126367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:25.126643 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:25.134755 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:25.136335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:25.144360 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1422/2846] 10.222.0.52 () {60 vars in 1384 bytes} [Tue May 10 19:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:08:30.509434 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20eb8e-cd83-4511-8718-ca3e8cf21a07 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:30.519438 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20eb8e-cd83-4511-8718-ca3e8cf21a07 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:30.523235 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:30.523879 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:30.524164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:30.524440 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:30.526885 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:30.537164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:30.538652 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:30.547080 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1425/2847] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:08:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:08:31.986971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:31.988450 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:32.003048 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acfaa2-bb8b-495e-b791-c3d3801a3bd8 service swift] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.008221 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.009143 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.009424 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.009700 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] PATH_INFO: `/v3/users/e2e0c60d84764101a21c82eb64c565ce` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.010982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e0c60d84764101a21c82eb64c565ce)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.013032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.061236 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e0c60d84764101a21c82eb64c565ce'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.061829 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e0c60d84764101a21c82eb64c565ce'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.074279 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e0c60d84764101a21c82eb64c565ce'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.082664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e0c60d84764101a21c82eb64c565ce'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.089717 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e0c60d84764101a21c82eb64c565ce'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.096024 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1423/2848] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:08:31 2022] DELETE /identity/v3/users/e2e0c60d84764101a21c82eb64c565ce => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:32.278201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:32.297875 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d36f-14ef-48fa-b469-e8a172b36c42 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.367444 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.368313 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.368602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.368905 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] PATH_INFO: `/v3/projects/9eb01bc12113463ab0f3d9d80b011053` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.370168 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb01bc12113463ab0f3d9d80b011053)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.372039 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.423704 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb01bc12113463ab0f3d9d80b011053', 'request_id': 'req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.432980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb01bc12113463ab0f3d9d80b011053', 'request_id': 'req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.439827 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb01bc12113463ab0f3d9d80b011053', 'request_id': 'req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.450962 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] The token cache is being invalidate because project 9eb01bc12113463ab0f3d9d80b011053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:08:32.451263 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.451936 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.456736 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1426/2849] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:08:32 2022] DELETE /identity/v3/projects/9eb01bc12113463ab0f3d9d80b011053 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:32.457974 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:32.459669 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:32.473938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72292f-556d-402c-8a24-60f3239b93e0 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.532228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.533156 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.533434 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.533732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] PATH_INFO: `/v3/users/e2a8a7c8abbc47a98c580cb1540e68c3` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.535042 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a8a7c8abbc47a98c580cb1540e68c3)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.536951 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.583524 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a8a7c8abbc47a98c580cb1540e68c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.584328 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a8a7c8abbc47a98c580cb1540e68c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.598644 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a8a7c8abbc47a98c580cb1540e68c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.606671 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a8a7c8abbc47a98c580cb1540e68c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.614215 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-40146bdb-2ae0-452c-92e8-c22ad4fdfc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a8a7c8abbc47a98c580cb1540e68c3'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.621129 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1424/2850] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:08:32 2022] DELETE /identity/v3/users/e2a8a7c8abbc47a98c580cb1540e68c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:32.813981 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:32.815661 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:32.832455 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178a8c-a6d6-4d9e-9f13-43bee650ccbd admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:32.909616 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:32.910495 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.910784 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.911063 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] PATH_INFO: `/v3/projects/98c15f6eaedb4465b6711e1d2735fa8a` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:32.912340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c15f6eaedb4465b6711e1d2735fa8a)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:32.914306 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:32.960514 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c15f6eaedb4465b6711e1d2735fa8a', 'request_id': 'req-8a8fd544-30a4-42ee-879d-2c2e088431f1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.969750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c15f6eaedb4465b6711e1d2735fa8a', 'request_id': 'req-8a8fd544-30a4-42ee-879d-2c2e088431f1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.976589 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c15f6eaedb4465b6711e1d2735fa8a', 'request_id': 'req-8a8fd544-30a4-42ee-879d-2c2e088431f1'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.987756 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] The token cache is being invalidate because project 98c15f6eaedb4465b6711e1d2735fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:08:32.988092 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.988731 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-8a8fd544-30a4-42ee-879d-2c2e088431f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:32.990317 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1427/2851] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:08:32 2022] DELETE /identity/v3/projects/98c15f6eaedb4465b6711e1d2735fa8a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:08:32.995773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef890-b3bf-4b28-8497-006ef54e9310 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:32.996396 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef890-b3bf-4b28-8497-006ef54e9310 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:32.996510 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef890-b3bf-4b28-8497-006ef54e9310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.016630 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-baeef890-b3bf-4b28-8497-006ef54e9310 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:33.018593 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-baeef890-b3bf-4b28-8497-006ef54e9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:33.084114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1425/2852] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:08:33.145581 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb8b7-a141-498d-bd53-c06d325ce4a5 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.145859 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb8b7-a141-498d-bd53-c06d325ce4a5 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.146133 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb8b7-a141-498d-bd53-c06d325ce4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.170393 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-510eb8b7-a141-498d-bd53-c06d325ce4a5 None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:33.171850 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-510eb8b7-a141-498d-bd53-c06d325ce4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:33.181340 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1428/2853] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:08:33.185726 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef890-b3bf-4b28-8497-006ef54e9310 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.195887 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef890-b3bf-4b28-8497-006ef54e9310 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.201615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.202409 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.202715 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.202966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] PATH_INFO: `/v3/domains` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.203732 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79970) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:08:33.204038 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:33.205695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:33.218184 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1426/2854] 10.222.0.52 () {58 vars in 1152 bytes} [Tue May 10 19:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:08:33.222481 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eb8b7-a141-498d-bd53-c06d325ce4a5 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.232247 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eb8b7-a141-498d-bd53-c06d325ce4a5 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.239429 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.240109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.240391 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.240653 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.241719 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:33.243689 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:33.270909 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1429/2855] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:08:33 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:33.275615 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.285146 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0bef-a563-4826-8499-0de7d6c5e946 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.344590 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.345212 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.345535 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.345819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.346865 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:33.348900 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:33.371573 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1427/2856] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:08:33 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:08:33.375798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.386001 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7aead-e6ef-43d0-a2f2-9abe6c823306 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.391154 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.391896 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.392180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.392460 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.393277 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:33.394934 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:33.405524 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1430/2857] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:33.409493 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.419763 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def89c0-a054-4a50-a770-d70867c9d7de admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.425758 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a21c5d-f071-4216-a48b-79bbd4dac193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.426482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21c5d-f071-4216-a48b-79bbd4dac193 admin admin] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.426761 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21c5d-f071-4216-a48b-79bbd4dac193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.427037 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21c5d-f071-4216-a48b-79bbd4dac193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.427908 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a21c5d-f071-4216-a48b-79bbd4dac193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:33.430228 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a21c5d-f071-4216-a48b-79bbd4dac193 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:33.442895 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1428/2858] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:33.447158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.458773 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45467149-e9fe-4744-9106-b714915550bb admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.463960 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.464883 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] REQUEST_METHOD: `PUT` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.465164 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.465436 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] PATH_INFO: `/v3/projects/506b976cacbb411391ef566d0aac8add/users/66645430262249d986152d4ee873ab4e/roles/e7ad4f242602439f80a3999084d931dd` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.481373 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506b976cacbb411391ef566d0aac8add, user_id=66645430262249d986152d4ee873ab4e, role_id=e7ad4f242602439f80a3999084d931dd)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:33.484236 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:33.499475 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1431/2859] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:08:33 2022] PUT /identity/v3/projects/506b976cacbb411391ef566d0aac8add/users/66645430262249d986152d4ee873ab4e/roles/e7ad4f242602439f80a3999084d931dd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:33.504610 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead068-7f2c-4e40-96b8-d48356468b9e None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.504928 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead068-7f2c-4e40-96b8-d48356468b9e None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.505205 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead068-7f2c-4e40-96b8-d48356468b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.523194 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a2ead068-7f2c-4e40-96b8-d48356468b9e None None] MFA Rules not processed for user `7ac1c607394142e496b17c3444cb39d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:33.524431 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a2ead068-7f2c-4e40-96b8-d48356468b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:33.581041 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1429/2860] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:08:33.590695 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:33.592395 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:33.654657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566be9a7-5ba2-4f87-8746-8d8b817a6542 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:33.658952 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:33.659634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:33.659918 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:33.660201 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:33.670302 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:33.671814 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:33.683179 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1432/2861] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:08:38.745821 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c68245-ea53-40a0-89fd-5f0f081a5b73 None None] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.746376 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c68245-ea53-40a0-89fd-5f0f081a5b73 None None] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.746619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c68245-ea53-40a0-89fd-5f0f081a5b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.775776 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.auth.core [None req-a9c68245-ea53-40a0-89fd-5f0f081a5b73 None None] MFA Rules not processed for user `66645430262249d986152d4ee873ab4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79970) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:38.777441 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a9c68245-ea53-40a0-89fd-5f0f081a5b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:38.849490 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1430/2862] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:08:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:08:38.853971 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.865794 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2867a12-4010-4a45-8355-9707dc4af3f3 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:38.871634 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:38.872292 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:38.872570 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:38.872872 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:38.873564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:38.875517 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:38.905047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1433/2863] 10.222.0.52 () {60 vars in 1152 bytes} [Tue May 10 19:08:38 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:38.910432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c68245-ea53-40a0-89fd-5f0f081a5b73 None None] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:38.923197 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c68245-ea53-40a0-89fd-5f0f081a5b73 None None] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.014706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.015393 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] REQUEST_METHOD: `POST` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.015679 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.015952 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] PATH_INFO: `/v3/users` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.016694 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.018625 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.040429 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1431/2864] 10.222.0.52 () {60 vars in 1143 bytes} [Tue May 10 19:08:38 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:08:39.046365 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.058966 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ed47-e187-415c-b4a4-9e6f0a255ce8 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.064857 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.065528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.065811 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.066060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.066831 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.068423 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.080491 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1434/2865] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:39.084626 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.095097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b3b61-39d5-4794-a1bc-0e212f7cfedb admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.100801 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.101637 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.101914 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.102187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] PATH_INFO: `/v3/projects/87b16d09509c43259be394bca3fa1511/users/7e625f505b2d45ad80fc2fe2ee580c8b/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.119361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b16d09509c43259be394bca3fa1511, user_id=7e625f505b2d45ad80fc2fe2ee580c8b, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.122031 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.138896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1432/2866] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:08:39 2022] PUT /identity/v3/projects/87b16d09509c43259be394bca3fa1511/users/7e625f505b2d45ad80fc2fe2ee580c8b/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:39.142980 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.154013 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79307ba-7bcd-43c8-acf6-2d1155e647f4 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.213172 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.213823 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.214105 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.214382 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.215109 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.216750 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.230138 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1435/2867] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 19:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:08:39.235370 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:39.251496 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc5b46-2e16-400c-b3ab-4a4786ddbdc6 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:39.256455 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:39.257403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:39.257682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:39.257953 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] PATH_INFO: `/v3/projects/87b16d09509c43259be394bca3fa1511/users/7e625f505b2d45ad80fc2fe2ee580c8b/roles/4222709f8e2845f1943f943370bcd122` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:39.259971 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b16d09509c43259be394bca3fa1511, user_id=7e625f505b2d45ad80fc2fe2ee580c8b, role_id=4222709f8e2845f1943f943370bcd122)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:39.262695 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:39.274238 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1433/2868] 10.222.0.52 () {60 vars in 1482 bytes} [Tue May 10 19:08:39 2022] PUT /identity/v3/projects/87b16d09509c43259be394bca3fa1511/users/7e625f505b2d45ad80fc2fe2ee580c8b/roles/4222709f8e2845f1943f943370bcd122 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:41.843895 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:41.846002 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:41.867986 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dfb2e-8202-417b-ae49-905d53f42768 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:42.018777 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:42.020187 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:42.020578 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:42.021141 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] PATH_INFO: `/v3/users/b006c84e982f47b98737736511b88d57` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:42.022680 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b006c84e982f47b98737736511b88d57)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:42.025540 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:42.112819 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b006c84e982f47b98737736511b88d57'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.113526 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b006c84e982f47b98737736511b88d57'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.124090 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b006c84e982f47b98737736511b88d57'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.139417 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b006c84e982f47b98737736511b88d57'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.149708 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-3767d791-7a47-4e93-8488-fcb22a5a81c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b006c84e982f47b98737736511b88d57'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.158513 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1436/2869] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:08:41 2022] DELETE /identity/v3/users/b006c84e982f47b98737736511b88d57 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:42.451120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:42.453867 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:42.474513 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff721-0466-4c7b-a3f9-c62558d50da5 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:42.546824 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:42.548786 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:42.549167 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:42.549400 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] PATH_INFO: `/v3/projects/d3ac7f1015e34e5599e7880a030cc0a4` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:42.551361 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ac7f1015e34e5599e7880a030cc0a4)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:42.553335 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:42.617383 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ac7f1015e34e5599e7880a030cc0a4', 'request_id': 'req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.626322 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ac7f1015e34e5599e7880a030cc0a4', 'request_id': 'req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.635576 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ac7f1015e34e5599e7880a030cc0a4', 'request_id': 'req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.649881 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] The token cache is being invalidate because project d3ac7f1015e34e5599e7880a030cc0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:08:42.650308 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.651115 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:08:42.660804 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1434/2870] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:08:42 2022] DELETE /identity/v3/projects/d3ac7f1015e34e5599e7880a030cc0a4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:08:44.305939 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c6102-d69d-441d-b13f-afe82260bc7e None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.306413 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c6102-d69d-441d-b13f-afe82260bc7e None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.306500 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c6102-d69d-441d-b13f-afe82260bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.334091 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-683c6102-d69d-441d-b13f-afe82260bc7e None None] MFA Rules not processed for user `7e625f505b2d45ad80fc2fe2ee580c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:08:44.335324 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-683c6102-d69d-441d-b13f-afe82260bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:44.407243 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1437/2871] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:08:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:08:44.440999 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:08:44.443091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:44.520438 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4fb8-ca35-4860-a8bc-3f06e1b7ef72 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:08:44.526983 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:08:44.527682 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:08:44.527966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:08:44.528243 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:08:44.530435 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:08:44.589081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:08:44.590706 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:08:44.600070 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1435/2872] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:08:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:09:00.959245 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306c8a-2f21-47ab-b356-a410fe06d28d None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:00.959812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306c8a-2f21-47ab-b356-a410fe06d28d None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:00.959812 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306c8a-2f21-47ab-b356-a410fe06d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:00.978104 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-18306c8a-2f21-47ab-b356-a410fe06d28d None None] MFA Rules not processed for user `66645430262249d986152d4ee873ab4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:09:00.979299 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-18306c8a-2f21-47ab-b356-a410fe06d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:00.987694 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1438/2873] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:09:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:09:01.779091 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:01.780788 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:01.850673 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49556d9-d1ae-4897-8b7e-520ed30b0d2d service nova] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:01.856282 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:01.856961 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:01.857245 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:01.857522 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:01.859478 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:01.871681 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:01.873300 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:01.883742 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1436/2874] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:09:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:09:15.519343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18306c8a-2f21-47ab-b356-a410fe06d28d None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:15.534739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18306c8a-2f21-47ab-b356-a410fe06d28d None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:15.540572 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:15.541283 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:15.541563 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:15.541838 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:15.543782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:15.556989 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:15.558739 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:15.569824 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1439/2875] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:09:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:09:17.696275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:09:17.697920 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:09:17.757826 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ba5e-2943-443a-b311-32dd06d9c916 service placement] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:09:17.762428 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:09:17.763081 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:09:17.763368 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:09:17.763641 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:09:17.773444 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:09:17.774991 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:09:17.784567 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1437/2876] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:09:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:10:11.984583 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:11.986407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:12.053801 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef2ca-4ad3-4189-bcb3-6d71b460121d service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:12.059454 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:12.060097 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:12.060380 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:12.060657 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:12.062515 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:12.075041 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:12.076663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:12.087176 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1440/2877] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:10:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:10:13.015147 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:13.077419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eadbea-9fc1-4651-9c1f-84e3028d5c0d service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:13.085592 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:13.086286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:13.086628 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:13.086906 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:13.091077 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:13.167964 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:13.169599 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:13.179647 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1438/2878] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:10:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:10:14.541591 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:14.543070 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:14.578410 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e072ba-69fe-4d49-807d-1dede6225599 service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:14.582252 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:14.582922 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:14.583222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:14.583494 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:14.585467 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:14.671672 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:14.673163 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:14.693804 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1441/2879] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:10:21.707773 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:21.709363 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:21.722862 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92592c7-57eb-480d-97cf-80247b85e7bb service nova] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:21.727730 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:21.728601 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:21.728911 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:21.729187 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] PATH_INFO: `/v3/users/e6a3e88ec7374302a4e6fd98d018a187` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:21.730367 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a3e88ec7374302a4e6fd98d018a187)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:21.732296 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:21.780898 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a3e88ec7374302a4e6fd98d018a187'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:21.781550 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a3e88ec7374302a4e6fd98d018a187'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:21.793097 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a3e88ec7374302a4e6fd98d018a187'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:21.801136 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a3e88ec7374302a4e6fd98d018a187'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:21.808114 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a3e88ec7374302a4e6fd98d018a187'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:21.813957 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1439/2880] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:10:21 2022] DELETE /identity/v3/users/e6a3e88ec7374302a4e6fd98d018a187 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:10:21.999902 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:22.015177 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b24f7-aa14-4364-b0c9-963c2bd68aec service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:22.073019 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:22.073900 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:22.074180 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:22.074458 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] PATH_INFO: `/v3/projects/2eec603f7854489393b8c4ed68874746` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:22.075676 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eec603f7854489393b8c4ed68874746)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:22.077650 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:22.124510 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eec603f7854489393b8c4ed68874746', 'request_id': 'req-f6c6db33-8560-4ecf-98a5-c4ce56660c69'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.133577 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eec603f7854489393b8c4ed68874746', 'request_id': 'req-f6c6db33-8560-4ecf-98a5-c4ce56660c69'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.139717 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eec603f7854489393b8c4ed68874746', 'request_id': 'req-f6c6db33-8560-4ecf-98a5-c4ce56660c69'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.149690 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] The token cache is being invalidate because project 2eec603f7854489393b8c4ed68874746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:10:22.149974 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.150614 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.152169 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1442/2881] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:10:21 2022] DELETE /identity/v3/projects/2eec603f7854489393b8c4ed68874746 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:10:22.156432 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:22.158089 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:22.172297 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bdbd4-9110-4fbf-a679-6ee37f34253c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:22.238316 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:22.239262 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:22.239545 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:22.239819 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] PATH_INFO: `/v3/users/bc64c21c0d534e81a44d36c72fc88c16` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:22.241177 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc64c21c0d534e81a44d36c72fc88c16)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:22.243249 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:22.292713 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc64c21c0d534e81a44d36c72fc88c16'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.293418 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc64c21c0d534e81a44d36c72fc88c16'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.305032 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc64c21c0d534e81a44d36c72fc88c16'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.313933 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc64c21c0d534e81a44d36c72fc88c16'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.320724 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc64c21c0d534e81a44d36c72fc88c16'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.326419 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1440/2882] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:10:22 2022] DELETE /identity/v3/users/bc64c21c0d534e81a44d36c72fc88c16 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:10:22.513213 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:10:22.514663 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:10:22.528506 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6db33-8560-4ecf-98a5-c4ce56660c69 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:10:22.587218 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:10:22.588117 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:10:22.588398 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:10:22.588691 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] PATH_INFO: `/v3/projects/3edc3b8b7c564e348105d0218d64b958` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:10:22.589901 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edc3b8b7c564e348105d0218d64b958)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:10:22.592270 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:10:22.639543 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edc3b8b7c564e348105d0218d64b958', 'request_id': 'req-0afb31b2-b805-47bd-8536-6f1111a759dc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.647445 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edc3b8b7c564e348105d0218d64b958', 'request_id': 'req-0afb31b2-b805-47bd-8536-6f1111a759dc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.653913 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edc3b8b7c564e348105d0218d64b958', 'request_id': 'req-0afb31b2-b805-47bd-8536-6f1111a759dc'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.664150 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] The token cache is being invalidate because project 3edc3b8b7c564e348105d0218d64b958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79971) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:10:22.664493 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.665167 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-0afb31b2-b805-47bd-8536-6f1111a759dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:10:22.666723 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1443/2883] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:10:22 2022] DELETE /identity/v3/projects/3edc3b8b7c564e348105d0218d64b958 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:11:20.571655 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:20.573345 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:20.674183 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829df142-c047-4bed-bfdc-95ea9799ec3c admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:20.746896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:20.747664 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:20.748015 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:20.748356 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:20.750275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:20.763275 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:20.765684 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:20.777675 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1441/2884] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:11:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:11:21.904007 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936209-36d3-4465-8232-8041a9da04ed None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:21.904532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936209-36d3-4465-8232-8041a9da04ed None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:21.904532 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936209-36d3-4465-8232-8041a9da04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:21.923278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-ee936209-36d3-4465-8232-8041a9da04ed None None] MFA Rules not processed for user `66645430262249d986152d4ee873ab4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:11:21.924482 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-ee936209-36d3-4465-8232-8041a9da04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:21.989246 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1444/2885] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:11:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:11:22.297597 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:11:22.299162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:22.360696 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56eb0-36d7-4eb4-a038-9b4712bf9c55 service placement] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:11:22.365023 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:11:22.365697 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:11:22.365984 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:11:22.366235 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:11:22.368413 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:11:22.378546 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:11:22.379982 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:11:22.388188 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1442/2886] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:11:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:22.848549 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] REQUEST_METHOD: `POST` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:22.849151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:22.849151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:22.867564 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.auth.core [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] MFA Rules not processed for user `66645430262249d986152d4ee873ab4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79971) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:13:22.868816 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:22.877351 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1445/2887] 10.222.0.52 () {58 vars in 957 bytes} [Tue May 10 19:13:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:13:22.912938 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:22.915873 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:23.010207 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283982f-3c56-4d82-8ce8-d81e3af6276c service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:23.014574 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cb476654be463e9d7d19d92576e495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:23.015234 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:23.015500 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:23.015774 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:23.017863 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:23.119075 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:23.120904 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:23.142353 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1443/2888] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:23.897427 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:23.899026 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:23.912381 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56393fe-829c-48ee-b1d4-dde3a441b952 None None] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:23.916370 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:23.917047 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:23.917357 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:23.917630 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:23.919465 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:23.932806 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:23.934227 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:23.945308 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1446/2889] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:13:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:37.184977 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:37.195808 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b83ccb-b47e-4c06-a382-0d340c77517e service cinder] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:37.202085 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:37.203087 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:37.203482 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:37.203886 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:37.206896 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:37.217743 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:37.219185 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:37.227415 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1444/2890] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:13:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:13:41.200110 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:13:41.201697 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:41.215272 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9fe7f-1576-4966-9d87-0793426a80b0 service neutron] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:13:41.221202 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:13:41.221923 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:13:41.222267 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:13:41.222607 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:13:41.224586 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:13:41.237809 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:13:41.239407 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:13:41.250431 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1447/2891] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:13:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:08.672942 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:08.682609 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853a96e-1b57-4e0c-92f9-0b0bd8664bd2 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:08.686966 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:08.687617 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:08.687894 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:08.688162 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:08.690270 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:08.702768 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:08.704242 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:08.713133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1445/2892] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:15:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:12.499060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:12.501158 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:12.516892 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043802-bdd9-414d-84e7-f5b5f803be62 service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:12.522932 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff69f29cd4341f488887fea0dd2e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:12.523716 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:12.524060 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:12.524343 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:12.526137 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:12.539265 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:12.540979 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:12.552230 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1448/2893] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:15:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:22.354078 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:22.364483 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dec83-210b-46d9-b478-3ff2c52627be service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:22.370157 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945283f83c1b4ee0a1a59b0732090fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:22.371120 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] REQUEST_METHOD: `GET` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:22.371403 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:22.371645 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:22.374213 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:22.445822 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:22.447304 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:22.457751 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1446/2894] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:15:28.691662 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:28.694305 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:28.708126 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951257-14e9-4f07-bcf1-833251a470d1 service nova] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:28.713798 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:28.714721 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:28.715003 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:28.715278 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] PATH_INFO: `/v3/users/66645430262249d986152d4ee873ab4e` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:28.716696 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66645430262249d986152d4ee873ab4e)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:28.718803 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:28.771099 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66645430262249d986152d4ee873ab4e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:28.771760 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66645430262249d986152d4ee873ab4e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:28.781441 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66645430262249d986152d4ee873ab4e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:28.798528 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66645430262249d986152d4ee873ab4e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:28.805319 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66645430262249d986152d4ee873ab4e'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:28.811703 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1449/2895] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:15:28 2022] DELETE /identity/v3/users/66645430262249d986152d4ee873ab4e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:15:28.989504 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:29.000701 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a129d-b58a-4ed4-8e00-67b581755b45 service neutron] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:29.058802 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:29.059677 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:29.059939 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:29.060209 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] PATH_INFO: `/v3/projects/506b976cacbb411391ef566d0aac8add` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:29.061410 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506b976cacbb411391ef566d0aac8add)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:29.064066 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:29.121063 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506b976cacbb411391ef566d0aac8add', 'request_id': 'req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.129919 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506b976cacbb411391ef566d0aac8add', 'request_id': 'req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.136619 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506b976cacbb411391ef566d0aac8add', 'request_id': 'req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.147502 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] The token cache is being invalidate because project 506b976cacbb411391ef566d0aac8add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:15:29.147782 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.148530 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.150250 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1447/2896] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:15:28 2022] DELETE /identity/v3/projects/506b976cacbb411391ef566d0aac8add => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:15:29.154402 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:29.156175 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:29.170128 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20ca5-7e09-4401-ac69-de12a5d19fe2 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:29.225669 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:29.226602 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:29.226840 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:29.227151 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] PATH_INFO: `/v3/users/7e625f505b2d45ad80fc2fe2ee580c8b` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:29.228376 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e625f505b2d45ad80fc2fe2ee580c8b)` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:29.230372 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:29.278590 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e625f505b2d45ad80fc2fe2ee580c8b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.279222 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e625f505b2d45ad80fc2fe2ee580c8b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.287907 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e625f505b2d45ad80fc2fe2ee580c8b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.299930 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e625f505b2d45ad80fc2fe2ee580c8b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.307055 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.notifications [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e625f505b2d45ad80fc2fe2ee580c8b'} {{(pid=79971) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.313487 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1450/2897] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 19:15:29 2022] DELETE /identity/v3/users/7e625f505b2d45ad80fc2fe2ee580c8b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:15:29.497133 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Authenticating user token {{(pid=79970) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:15:29.499807 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.fernet_utils [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79970) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:15:29.521374 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4010bde-e8fb-4bb2-9a4f-6fd5e022dc96 admin admin] Validating token access rules against request {{(pid=79970) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:15:29.579150 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac1c607394142e496b17c3444cb39d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55014cd93ec34248b9cee6790f6f8c90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79970) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:15:29.580025 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:15:29.580310 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:15:29.580586 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] PATH_INFO: `/v3/projects/87b16d09509c43259be394bca3fa1511` {{(pid=79970) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:15:29.581841 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b16d09509c43259be394bca3fa1511)` {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:15:29.583723 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] RBAC: Authorization granted {{(pid=79970) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:15:29.630484 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b16d09509c43259be394bca3fa1511', 'request_id': 'req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.638831 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b16d09509c43259be394bca3fa1511', 'request_id': 'req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.645289 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b16d09509c43259be394bca3fa1511', 'request_id': 'req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6'} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.655290 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] The token cache is being invalidate because project 87b16d09509c43259be394bca3fa1511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79970) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:15:29.655662 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.656286 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: DEBUG keystone.notifications [None req-9fb0a9d0-34bb-419f-b73d-1906a291e7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79970) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:15:29.657897 dv-cinder-836996-18-iscsi devstack@keystone.service[79970]: [pid: 79970|app: 0|req: 1448/2898] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 19:15:29 2022] DELETE /identity/v3/projects/87b16d09509c43259be394bca3fa1511 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:17:17.769052 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Authenticating user token {{(pid=79971) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:17:17.770711 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:17:17.842622 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c313a-a635-4a5c-9991-f55c06e838f3 admin admin] Validating token access rules against request {{(pid=79971) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:17:17.909135 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176f35a-ead5-4818-ba65-f0199bd287cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '698df68d01c641c1b4455509d798d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793749d38e914b408bc7d94b6053d624', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79971) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:17:17.910045 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176f35a-ead5-4818-ba65-f0199bd287cc service placement] REQUEST_METHOD: `GET` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:17:17.910329 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176f35a-ead5-4818-ba65-f0199bd287cc service placement] SCRIPT_NAME: `/identity` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:17:17.910601 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176f35a-ead5-4818-ba65-f0199bd287cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79971) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:17:17.912782 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.fernet_utils [None req-7176f35a-ead5-4818-ba65-f0199bd287cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79971) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:17:17.923917 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176f35a-ead5-4818-ba65-f0199bd287cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:17:17.925527 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176f35a-ead5-4818-ba65-f0199bd287cc service placement] RBAC: Authorization granted {{(pid=79971) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:17:17.935390 dv-cinder-836996-18-iscsi devstack@keystone.service[79971]: [pid: 79971|app: 0|req: 1451/2899] 10.222.0.52 () {60 vars in 1365 bytes} [Tue May 10 19:17:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)